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Chapter 1 Solutions 


1.9.8. We have that 

lim inf A n = B fl C, lim sup A n = B U C. 

n ~ n — vr**) 


1.9.9. We write 

AAB =AB c \jBA c 


while 


A C AB C =A C (B C ) C (J B C (A C ) C = A c B{Jb c A. 


1.9.10. Suppose that A n — > A. Then lim inf^,*, A n = A so if u G A, then 
for some no, w £ /t„, for n > n o- Thus 

1 = U(w) = lim U„(w). 

n — too 

If w G A c , then u> G (lim sup,^^ A n ) c = liminfn^oo and therefore 
0= l,t (w) = lim l^fw) 

n-f oo 

since l j4n (w) = 0 for all sufficiently large n. 

Conversely, suppose 1^ -> 1^. Then if w G A, it follows that l/i n (w) -> 
1. Since indicator functions take on only the values 0 or 1 we get that 
U„(w) = 1, for all large n, say n > n 0 and w G A n , for n > n 0 and 
w G lim infn^TC A n . Thus A C liminf„_ +00 A n C limsup„_ >0O A„. 

If ;w € A c , then 1,4,, (w) — ► 0 so oj G A „ , for n > no- Hence A c C 
limmfn-voo A c n , or equivalently A D (liminfn^oo A') c = limsup^^^, A n . 

1.9.11. We first show that 

(J[0,a») = [0,supo„). 

n 

If LO belongs to the left side union, then w < a n for some n and therefore 
u) < sup„ a„ and w G [0, sup n a n ) which is the right side. Ifw G [0,sup ra a n ), 
that is, u belongs to the interval on the right, then w < sup n a n and w < a. n 
for some n which implies u> G U„[0, a„). 

For the second part, sup„ ^ = 1 and 1 g U„[0, jjfpy] = [0, 1). 

1.19.14. Suppose A n is a field for each n and that A n t • Since A n is a 
field ft G A n for all n and therefore ft G U n A n - If A G U„.4„, then A G A n 
for some n which implies A c G A n which implies A c G U n A n . So U „A n is 
closed under complementation. 
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If A, B £ U n A n , there exist n, m such that A £ A n and B £ A m . Thus 
A, B £ Anvm and A D B £ A n vm (since fields are closed under finite 
intersection). This yields AB £ L) n A n - 

1.9.15. We suppose ft = {1,2, ...} and define 

C j = {A:Ac{l,2,..j}}. 

Set cr (Cj) =: Bj. Check that 

Bj = Cj U {A U {j + 1 ,j + 2, ...} : A £ Cj } . 

If A £ Bj satisfies the property that the number of elements of A is infinite, 
then A D {j + 1 ,j + 2, ...}. 

Let Aj = {2j — 1), j = 1,2, ... so 

(A 1 ,A 2 ,A 3 ,...) = ({1),{3},{5},...). 

Then 

Aj £ B 2j -i C [J B n 

n 

but 

j n 

since U jAj is an infinite set but for no j is it true that {1, 3, 5, 7, . . .} D 
{ j + 1) J + 2, ...}. 

Note that a union of cr-fields is not necessarily even a field. Let ft = 
{1,2,...} and Bi = <r({i}) = {0, ft, {*}, {?} c } for i = 1,2. Then {?} £ 5, 

but {1}U{2} = {1,2 }^BiUB2- 

T.9.17. We have u £ lim inf„_,.oo A n iff w £ A n for n > no for some no- 
This is equivalent to l / i n (w) = 1 for n > no- But since indicators only 
take values 0 or 1, the only way a sequence of indicators can converge 
to a limit is if the indicators equal the limit from some index on. This 
means that the statement: for some n > no, l / t n (ui) = 1 is equivalent to 
linin-yoo l An (u) - 1. 

1.9.18. We check the three postulates for a field or algebra: 

(i) ft G A by assumption 


(ii) Complementation: If A £ A, then since ft £ A we have ClA c — A c £ 
A. 

(iii) Suppose A,B £ A. Then AB C £ A so A D (AB C ) C = A n (A c U B) = 
AA C U AB = AB £ A. 
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1.9.19. We have I^ub(w) ^liffwGAUBiff either 1 , 4 ( 0 ;) = 1 or 

1 b(w) = 1 iff V 1 b(w) = 1. 

Likewise, \ ac \ b { w ) = liffwGAnBiff both l^(w) = 1 and l B (w) = 1 
iff U(w) A 1 b(w) = 1. 

Since indicators take only values 0 or 1 we are done. 

1.9.20. Define 


TO 71 'j 

A := P| Aij : A{j £ Cor A*j G C} 

»=i j = l 

and remember the summation notation for sets implies a disjoint union. 
We claim A is a field and verify the field postulates: 

(i) Pick A G C so that ( A c ) c G C and thus 

Q — A. -f- A c G A. 

(iii) Closure under finite intersection: Suppose 

yi n A{ i and n n a m 

i€I j€J, ker leJ' k 

are two sets in A. Then the intersection is 

f n Ai i n n 

(:,fc)e/x/' \j€J, ieJ' k ] 


which is also in A. 


(if) Closure under complementation: The complement of a typical set in 
A is 

/ \ c 


fl Ai J 


in n | 

= nu 4 


i=l j=l 


To show that this set is in A, it suffices because of (iii) just checked, 
to verify that one of the sets in the intersection is in A and hence it 
suffices to show that U ] =l Aj G A where Aj G C or Aj G C. However, 
we may write 


U A j—Ai+ A\A\ + A^Ai A 2 + b A„AiA2 . . . A„-l, 

j = 1 


which is a disjoint sum of sets of the form n* =1 B,- where B t G C or 
Bf G C. Therefore (J" =1 A j G A as required. 
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So A is a field. For any A G C, A G A so C C A and therefore the minimal 
field over C is contained in A: 


-4(C) C A. 

Also, if Aij or A c { - G C, then A {j G A{C). Therefore G A{C) so 

521 = 1 O^ljAy £ A(C). We conclude that A C A(C) as well. 

1.9.26a. Set C = {Ai, ...,A n }, where Yli=i Ai = fi. We claim 

A{C) = {\jAu /C{1, 

iei 

is the minimal algebra over C. Denote the right side collection of sets by 
A. To prove the claim, we first show that A is a field. To do this, we verify 
the postulates. 

(i) First of all, fi G A since we may take I = {1, ..., n }. 

(ii) If A — Uj£/Aj G A, then A c — Ujg/c Aj G A. 

(iii) If Aj - U izijAi, for j = 1,2, then Ai U A 2 = U i € i u i 2 Ai G A. 

So A is a field, A 3 C, so by minimality we have A D -4(C). But clearly, 
since A,- G C C -4(C), we have A C -4(C). The two set inclusions give the 
desired equality. 

1.9.27. Call Q the rational numbers and define 

<S(M) =(t{(«, 6] : — oo < a < b < oo} 

and 


T =<j{(a., 6] : — oo < a < b < oo, a,b G Q). 


For q,s G Q, 

(q, s] G {(a, 6] : — oo < a < b < oo} C B(ffi). 

Therefore T C B(M). 

On the other hand, for any a,b 

{a,b]~ lim(g„,s„] 

n — hdo 

where q n | a and s n | b and q n , s n G Q. So (a, 6] G T and B(M) C T . 

1.9.28. Let Z= {..., — 1,0, 1,2, ...}. Let T be the periodic sets. A set A is 
periodic , written A G T, if for all natural numbers nGlwe have x £ A iff 
x ± n G A. We verify the cr-field postulates for T\ 
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(a) First of all, i£f. 

(b) Complementation: Next, suppose A £ T and we show A c £ T . If 
x £ A c , then for any n £ Z, we claim x + n £ A c . If not then x + n £ A 
and since A is periodic (x + n) — n = x £ A, a contradiction. 

(c) Closure under countable unions: Let Bj £ T for j > 1. We show 
U jBj £ T. If x £ UjSj, then there exists jo such that x £ Bj 0 . For 
any n £ Z, x + n £ B jo C UfBj. 

1.9.29. Let X>(C) be the smallest class containing C and closed under count- 
able intersection and union. This minimal structure exists since closure 
axioms define the structure. Then C C X>(C). Also a(C) is closed under 
countable union and intersection and since cr(C) D C, we get 

a(C.) D V(C). 

Let 

F:= {A £ V(C) : A c £ V(C)} . 

We claim T is a cr-field. Note if A„ £ T , then A„ £ V(C) and A£ £ T>(C). 
This means U„A n £ T>(C) and therefore 

(U A ") C = n A ne^). 

n n 

since A£ £ V(C). So T is closed under countable unions. 

If A £ T so A c £ T>(C), then A c satisfies 

(A c ) c = A £ T C V(C) 

which implies A c £ T . So F is closed under complements. 

Is fi £ Since A £ V(C) implies A c £ T>(C) and = A + A c £ V(C) 
and 0 = A (~l A c £ V(C ), we get £ T . 

We claim, next, that T D C. The reason for this is that if A £ C C T>(C), 
then 

A c = UCi£D(C) 

i 

where {C,} are each sets in C. So T is a <r-field, T D C, so F D a (C). But 
by definition, T C T>(C). We conclude that a(C) C T>( C ). 

1.9.31. If ft is countable, then C {{x} : x £ ft} is a countable generating 
class, since for any A C ft, A = U a€/ i A a . 

Now let ft be uncountable. For the purpose of getting a contradiction, 
suppose C = {C n , n > 1} is a countable generating class for the cr-field of 
countable-cocountable sets. Define 

_ I C n , if C n is countable, 

" otherwise. 



6 


So C* is always countable and so is C = U n C*. Therefore, C c is uncount- 
able. 

Pick x,y E C c such that x ^ y. For any n, 

r i _ }C' n , if C n is not countable, 
otherwise. 


Let 

T = {Ae <t(C) : {z, y] C A or {z, y} C A c }. 

For any n, {z, y} C either C„ or QsoCC T. Further properties of T\ 

1. {z, y] c n so Q E T . 

2. If A E T , then A c £ T. 

3. If A n E T , then since J- C cr{C ), U n A n E <?{C). If there exists n such 
that {z, y) C A n , then {z,y} C U n A n and l) n A n E T. If for all n, 
{z, y} C A c n , then {z,y} C n n A„ which implies U n A n E T ■ 

So we conclude T is a cr-field and since C C T , we get cr(C) C T and 
since also T C cr (C) we get T = cr (C). 

For A E T, either {z,y} C A or {z,t/} C A c . But {z} £ cr(C) and 
{ x - y} <£ {^} and {x,y} <£_ {z} c . So {z} ^ T which gives a contradiction. 

1.9.34. Let 

g := {AB + A C B' : B, B' £ B}. 

We claim Q is a cr-field. To verify this note 

i. n = An + A c n e g. 

:■ 2. If B n , B' n E B for n > 1, then AB n + A c B' n and 

\jAB n + A'B' n =An(^jB n )+A‘r\{[jB' n ) Eg 

n n n 

since U n B n and U n B' n are both in B. 

3. If AB + A C B' E g then 

(AB + A c B') c =(AB) c n [A C B') C = (A c U B c ) n (A U ( B') c ) 

= (A C {B') C + AB^ U B C (B') C 
=A C {B') C U AB C U AB C {B') C U A C B C (B') C 
=A(B C U B C (B') C ) U A C ({B') C U B C {B') C ) 

—AB C + A C (B') C . 
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So Q is a c-algebra. 

Also, we have A £ Q and B C G and therefore 

GD<t(B, A). 

Also, 


G c ff{B\j{A}) 

since the right side contains B and A and hence contains sets of the form 
BA + B'A C . 


1.9.35. Suppose T is a countably-infinite cr-field so that we can write it as 


F={B 1 ,B 2 ,...}. 

For N = {1,2,...}, let 

e = ( e l: £2, • • • ) E {0, 1} N , 

and write 

00 

£e = f| B i’’ 

i — l 

where 

B u = { Bi ' if€f = 1 ’ 

’ \Bf, if = 0. 

Set. 

C={s e ,e6{0,l} N }. 
Since T is a cr-field, C 6 T . Note also that 

Be p| B e > = 0, if e ^ e', 


so sets of C. partition Cl. 

Now we claim that C. contains infinitely many non-empty sets. If not, 
then there are finitely many non-empty sets in C which partition Cl. This 
implies a(C) is finite. But a(C) = T since 

(a) C C T implies a(C) C T . 

(b) If Bk £ IF, then 

Bk= U B e £a(C), 

e-(k = 1 


and hence T C cr(C). 
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This would mean that T is finite which contradicts the assumption that T 
is countably infinite. 

So, since C has infinitely many non-empty sets, we write 

C:= {0,Ci,C 2 ,...} 


where C,- ^ 0, i > 1. 

Define a function / on the subsets of N by 

f:V(N)^T, f(I) = 1J Ci. 

iei 

We claim that / is 1-1. To see this note that U, e /C, = U jg/'Cj implies 
that 1 = 1' since The C, ’s are disjoint and non-empty. 

So for all I G '7 7 (N), /(/) G J- and hence T cannot be countably infinite 
since a subset {/(/),/ G 'P(N) is in 1-1 correspondence with 'P(N) which 
has cardinality 2 K °. 

1.9.44. To see that A C A, note that if A G A, then we may set A n = A 
so that .4,, —¥ A showing that A £ A. 

We now see why A is a field. We verify the field postulates: 

1. Since 0, G A, and 4c4we have 0, G A. 

2. Suppose A G A. Then there exist A n G A and A n ->■ A. Since A is a 
field, we have A„ G A. Thus 

limsup>l£ =(lim inf/l,i) c = A c , 

n— *-oo n—Kco 

liminMjij =(limsup^4, l ) c 

* , °° n— >oo 

j and so A c n — »■ A c . Thus A G A. 

3. Suppose A, B G A. Then there exist A n G A, B n G A such that 

A n — t A, B n — > B. 

It follows that A n B n G A and we show that A n B n — >■ AB proving 
that A is closed under finite intersections. First of all 

OO 

lim sup An P| -Sn = n U AkBk C lim supv4„ = A 

co . , . . n— »-oo 

«= 1 n>k 


and similarly 


lim sup P|B„ = P| (J A k B k C lim sup 5 n = B 


k=l n>k 
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so that 

lim sup A n P) B n C AB. 

n-foo 

On the other hand, since liminfn-yoo A n B n is the points in A n B n for 
all large n, we have 

liminM„.0 n = lim inf A n Pi lim inf B n — AB. 

n—too n— ► oo • * n— >oo 

Thus 

AB = liminM„.B„ C limsupyl n 5 n C AB. 

n-KX* n-+ oo 

Thus A n B n ->■ AB and AB G A. 
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Chapter 2 Solutions 


2 . 6 . 1 . 

(a) First of all = 0 is finite so fl £ To- 

Next check closure under complementation: If A £ To then either A 
or A c is finite. Therefore A c £ To since either ( A c ) c or A c is finite. 

Finally check closure under finite intersection: Suppose Aj £ To, i = 
1 , 2 . If one of A\, A2 is finite, then A1A2 is finite and hence in To- If 
neither set is finite, then Aj and A\ are finite, so A\ U A\ is finite. 
Therefore (A\ U A|) c = A1A2 £ To- 

(b) Let E\,...,Ek G To, Ei fl j Ej =0, for i yf j. At most one can be 
infinite, since if E\ and E 2 are both infinite and E\ fl E 2 = 0, then 
E\,E2 are finite which implies E^ U E\ is finite. So (El U E ^) 0 is 
infinite and in To- However, we also have ( E\ U E^Y = E 1 E 2 — 0, 
which gives a contradiction. 

If none of E\, E2, - - - Ek is infinite then 
k k 

P (U Ej) = 0 = Y^P{Ej), 

j= 1 i=i 

If exactly one is infinite, then \Jj =1 Ej is infinite and P(U* =1 Ej) = 
k 

1 = ^2 PEj, since the latter is a sum of ( k — 1 ) zeros and one 1 . 
j = 1 

; P is not tr-additive. Let flyv be finite and fijv t ft. If P were <r-finite, 
we would have 

o = p(n JV )ti , (n) = i. 


(c) Define 


P(E) = 


0 , 

1 , 


if E is finite, 
if E c is finite. 


Suppose Ei,E2,--- G To and (J,- £7j £ To and {£„} are mutually 
disjoint. As in (b), at most one E n can be infinite. Then either 


(I) Ci P* ^ finite, in which case Ei is finite for all i and PflJ,- Ei) = 
0 = £,• P(Ei) 


or 
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(II) ((Jl?,)^ is finite. This means there exists i such that Ef is finite 

i 

and and because at most one of the {E n } can be infinite, for all 
j ^ i, Ej is finite. Therefore 

PiljEi) = 1 = £>(£*) = P(Ei) + £>(£,■) = 1 + 0. 

* * 

2.6.2. The result can be proven using the representation for A (see Problem 
1.9.20, page 23) 

m n , n v 

A = { P| Aij : Aij G V or A°j G V and P| Aij , i = 1 , . . . , m are disjoint} . 
= l j = 1 

Given two probability measures P\ and P 2 which agree on V we need 

/TO H- 1 TTt 12 1 

Mjn^>=£*(rN 

• = 1.7 = 1 i=l j = 1 


to be equal to 


m rij 

1=1 j = 1 

Therefore, it suffices to prove for + 1 , . . . , .4*, where Ai G V or Af G P, 
l = 1 ,...,& that 


k k 

A(n^)=^n^)- 

; /=i i=i 

Separate the j4’s into two groups {Ai,i G /} and {Ai,l G J } where 1+ J = 
{1, . . . , k) and Ai G V for i G / and Af G P for l G J . Call B\ = fl, •£/+,■ so 
that Bi G V since P is a ir-system. We need to prove 

Pi(Bi 0(0^)) = Wi f|(f>))- 

iej ieJ 


Write 


p,(5i nn^)) = p *( s i H(U^r) = pdB 1 ) - 

l€J l€J l£J 

=P(Br) - PiUB^j) 

l€J 


and apply inclusion-exclusion. 
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2.6.3. If Bi C Ai then U |J3,- C U,-2l,- and 

o =o»na»' = (i» run 8 ?) 

* i i i i 

=U(^n 5 i) c u A > B t 

* 3 i 

SO 

^(U^)-^(U 5 *) < < J2 p ( A < B i) = 'ZiPM-Pim 


2.6.4. First of all, the extension is certainly not unique. For an easy exam- 
ple, take B = {0, fi} and A £ B. Then 

B l =v{A,B) = {<b,Sl,A,A c }. 

Knowing a probability on {0, 0} does not give much instruction about how 
to extend it to A and A c . 

Here is one way to extend using outer and inner measure. For any 5 C ft, 
define 

P*(S) := inf{P(B) : S C B, B e B). 

Let B n £ B y S C B n , P{B n ) 4- P*(S). Such a sequence {B n } exists by 
definition of “inf” . Now define 

00 A'" 

s* = n Bn = j im n Bn ■ 

1 i N—too 1 1 

n = l n = 1 

Thus, S’ 6 By S C 5* , and therefore 
P’{S) <P{S’) 

'(from the definition of P*) 


N 

= Jim |P(f)S n )< Jim P(B N ) = P’(S). 

N—*co 1 1 N—tco 

n = l 

We conclude 


P*(5) = P(S’). (2.6.4. 1) 

Next, we claim, if C € P and 

B 3 C C S’ \ S, then P(C) = 0. 

This follows from S C S* \ C, S’ \ C E B, and thus 
P{S’) =P’(S) < P(S’\C) 


(2. 6. 4. 2) 
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(from the definition of P*) 


= P(S*)-P(C), 

(since Cc5‘) whence P(C) = 0. 

Next define, for any Scfl, 


5 . = ((ST) C , 

so that S, G B, S* = ( S c )* D S c which yields, by taking inverses S t C S. 
Then 


P(S.) =1 -P{(S C )*) = 1 -P*(S C ) 

= 1 — inf{P(A) : S c C A, A g /?} 
= sup{P(A c ) :S c C A,Ag5} 

= sup{P(l/) : S c C P c ,l/g£} 
= sup{P(l/) :SDV,V€B). 


Also, as with (2. 6. 4. 2), if D C S\S t , and D g B, then P(D) = 0. 

Pick A g [0, 1] and define P x on B x = <r(B, A) = {BA (J B'A C \B, B' g B } 

by 


P x (BA\Jb'A c ) :=\P(A* B) + (1 - A )P{A,B) 

\P{(A*) C B') + (1 - \)P((A,) C B'), 

so that 

Pi(BA\Jb'A c ) = P X {BA) + P X (B'A C ). 

Here are the relevant properties of P x : 
lAPi is well defined on B\ = a (B,A). 

2. Pi extends P. This is clear since if B g B, 

P l (BA{jB'A c )=P 1 (B) 

=A [P{A* B) + P{{A-) C B)] 

(1 - A) [P(A.B) + P({Al)B)] 

=\P(B) + (1 - A)P(P) = P(B). 

3. Pi is a probability measure. 

To see why P x is a probability measure, note that clearly Pi(C) > 0 
for all C g B\ and Pi(fi) = P(fi) = 1. To verify cr-additivity, suppose 
B n A\J B' n A c g B x are disjoint for n > 1, where B n ,B' n E B\ . This means 
that {AB n , n > 1} are disjoint and {A c B' n ,n > 1} are disjoint. 
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For any n ^ m, AB„ fl AB m = 0 implies 0 = A»(AB n D AB m ) = 
A,B n fl A m B m since A. C A. Also A* B n fl A*B m C A* but 

(A m B n f| A*B m ) n A = A* f|(B n A n B m A) = 0, 

SO 

A*B n f}A'B m cA*\A 

and by (2. 6. 4. 2) 

P(A*B n f)A*B m ) =0. 

So {A m B n ,n > 1} are almost disjoint (see Problem 2.6.6) and 

oo oo 

A(U ABn) =AP 1 (((J B n )A) 

n=l n=l 

=Ap(((Jb„)A*) + (1 - A)p((|j5 n )A t ) 

n n 

=XP({J(B n A')) + (1 - A)p((J(S n A.)) 

n n 

=A£p(B n A*)+(l-A)£p(B„A.) 

n n 

= £ [A P ( B "A*) + (1 - A )P(B n A.)] 

n 

n 

A similar argument works on A c . 

We conclude that Pi is a probability measure that extends P on B to 

ft. 

2.6.6. Since 

PdJ^A.) = Iim P(U" iAj) 

n— >oo 3 J 

and 

oo n 

3 = 1 j=l 

it suffices to show P((JJ =1 Aj) = J2j=i PAj. To check this observe that by 
the Bonferroni inequality 

j^PAj- £ P(AiAj) < P(\J Aj) k'EpIAj) 

3 = 1 1 <i<j<n j = 1 1 

and since ^2P{A,Aj) = 0, the result follows. 

><j 
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2.6.8. We summarize the probabilities in the following chart 


ft 

abed 

Pi 

1111 

fi 3 3 fi 

P2 

1111 

3 6 6 3- 


Set 


C = {{«, 6}, {d,c}, {a, c}, {6, of}} 
and note C is not a 7r-system since 


MflM = M £ c - 

Check that a(C) = V{0.) and Pi = P 2 on C but not on <j(C) since, for 
instance, Pi({a}) = ± ^ ± = P 2 ({a}). 

2.6.9. (a) First of all, if F(x) - F(x-) > 0, then P{x } > 0 and if B C {x}, 
then either 5 = 0 so that P{B) = 5(0) = 0 or B = {x} so 5(5) = 5{x}. 
Thus 

{a; : F(x ) — F(x-) > 0} C { atoms of P}. 

Next suppose A is an atom of P. Define 

:= sup{x : 5((-oo, x) H A) = 0}, /? := inf{x : 5((x, oo) n A) = 0}. 

If a < /?, then 5((a,oo + fM) > 0, and P((p - ^,/?) D A) > 0 
which contradicts A being an atom. Hence a — [3. It follows that 

5((-oo,a- -) 0,4) = 0, 5((ar + — , oo) ft ,4) = 0 

n n 

and thus 

5((a- -,or+ -)flj4) = P(A) > 0. 
n n 

Let n —¥ oo to get 5({a} f\A) = P[A) > 0. So 5({a}A,4) = 0. 

(c) Let A and B be distinct, atoms. Then P(AAB) > 0 and therefore 
P(ABA%) = P(AB9 C ) + P{{AB ) C % ) = P(AB), and we claim that 

P(AB) = 0. 

Since AB C A and AB C B and A and B are atoms we have 
either P(AB) = 0, in which case the claim is true, 
or else P(AB) > 0, in which case, since A and B are atoms, we have 
P(B\AB) = P( J 4\ J 45) = 0, 

which means that P(AAB) = 0 which contradicts the assumption 
that P(AAB) > 0. 
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(d) Let 


A n = { distinct atoms which have probability at least — 

n 

There are at most n atoms in A n since if A\, G A n , then 

m m 

j = i j = i 

which makes m < n and card(*4„) < n. So 

card{ all atoms } = card([J>t„) 


which is at most countable. 

(e) A partially ordered set is a set S together with a relation, denoted <, 
on S x S; that is, on pairs of elements of S. This relation satisfies 

1. x < x, 

2. x < y and y < x implies x = y, 

3. x < y and y < z implies x < z. 

A subset C of S is called a chain or a totally ordered subset, if every two 
elements of C are comparable; that is, if x, y G C, then either x < y or 
y < x. An upper hound of a set A C S is an element y such that x < y for 
all x £ A. A maximal element of 5 is any j/GS satisfying y < x implies 
y = x. Zorn’s lemma says that if 5 is a partially ordered set in which every 
totally ordered subset has an upper bound, then S has a maximal element. 

' For a set A G B , recall 


A* - {B G B : P(AAB) = 0}. 

Define the partial order on the equivalence class of sets to be A & < B# 
iff there exists A G A B G B * and N G B such that P(N) = 0, and 
A C S U iV. This is a well defined specification of the relation. If also 
A' G A # and B' G B# , then 

A'A C = N U A{A') C = N 2 , 

where P(N{) = 0, i = 1,2 and 

A = AA! + N \ , A' = AA' + N 2 . 

Similarly, 

B = BB' + N 3 , b' = bb' + n 4 , 
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so 


A! —AA! + N 2 C B (J N (J N 2 

CBB'U AT 3 |Jn|JjV 2 c B'{Jn 5 , 

where Ns is an event with probability 0. 

We have now. defined a partial order relation on the equivalence classes 
of events since 

1. A* < A*. 

2. If A* < B* and B* < A* then 

b ca{Jn 2 

and so 

AcB(JWi Ci4(J(7Vi(JW2) 

and therefore P(AAB) = 0. 

3. If A* < B* and B * < C* then AcBUNi,BcCl)N 2 and thus, 
A C CU(JVi U N 2 ) so A* < C*. 

Now let S ft = { A & : P#(A&) < a}. We claim that any subset Sf which 
is totally ordered has an upper bound. Write 


and set 

p a = P*(A £), p So = sup P*(A*). 

or£ A 

By definition of supremum, there exists a n £ A such that 

P*„ = |P5 0 - 

To prove the claim, we consider two cases. 

Case 1 . Suppose p a < p$ 0 for all a £ A. Then we show for any a £ A, 

^<LUi 


so (J n A$ n is an upper bound in S& . (Note, that it is relatively easy, 
by taking finite approximations to {a n }, to verify that the upper 
bound is, in fact, an element of S 1 ^.) To verify this, pick any a £ A. 
Since p a < p So , there exists a n such that 


Pa < Pa n • 
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Then because of total ordering, either 

At < A* n or A# n < A a . 

The latter is incompatible with p a < p Un and we conclude 


A*<A* n <\jA* n 


as needed. 

Case 2. Suppose there exists a* G A such that p a • = ps 0 . Then we claim that 
U n A* n U A*. is an upper bound in S* . To see this, observe that for 
any a, either p a < ps 0 , in which case, as in Case 1, 

A tc{jA* n c{jA* n \jA a . 

n n 

or, if p a = ps 0 , then either 

A* < A* or A* < At . 

In the first, case, there exists A a • G Af. and A a G At such that 
U N D A a , and P(A a •) = P{A a ). 

So 

P(AaA C a .) = P(Aa) - P(A a Aa .) = 0, 

and 

P(Aa'A C a ) = P(Aa-) - P(A Q Aa>) = 0, 
so P(A a > £\A a ) = 0. Thus At • = At and 

i 'ifclutLK- 

Consider the alternative case similarly. 

By Zorn’s lemma, there exists a maximal element A* ax G S # such 
that P#(At,a. x ) < a. For the purposes of getting a contradiction, suppose 
P # (A^ ax ) < a. We show this implies the existence of an atom. 

Let 

C* = {B*^9:B*f]A* ax = <D}. 

For B * G C* , since B* D A^ ax = 0, 

P*{B*) + P*{A£ &X ) = P*(B* |J A# ax ) > a, 
otherwise we would get a contradiction in the following way. If 
P*{B*) + P*(A*„) = P*(B*[jA* ax ) < a, 
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then 


B* + A* 


e s* 


SO 

A# < B# \J A# < A# 

^max _ n ^ ^max _ ^max 

where the last inequality follows by maximality. Thus from the previous 
line we would have 

A* ax = B*{jA# ax 

and since B* ^0 we get the desired contradiction to maximality of A* ax . 
Thus we conclude 


P*{B*) > a - P*(A*„) = € > 0. 

Make a partial order on C * by defining B* < C * iff there exists B G B* 
and C G C& such that B U N D C . Note that C& is ordered by the inverse 
relation to the one used for S # . As before, any totally ordered subset has 
an upper bound in C* . The argument for this is similar to the argument 
used to show the corresponding fact for S * . For instance, if Sf is a totally 
ordered subset of C^, write 


Sf = {B*,ae Aj}, Po = P#(B*)>e, 


and define 

p inf pc > e. 

cx€ Ai 

There exist cr„ G Ai such that p an l p. If for all o G Ai, > p, then 
is the upper bound since for any a G Ai , there exist a n such that 
Pa„ < Pa- Then we claim Bf < n kB# k since 

k 

Either B& < Bf n or Bf n < Bf but the latter alternative is incompatible 
with the previous display so we get 

B*<Bl<f)B# n . 

n 

Handling the case that some a satisfies p a = p is similar to the procedure 
used in analyzing S& . 

Again by Zorn’s lemma, a maximal element B# ax G C& exists. It follows 
that B# ax is an atom. To see this, keep in mind P#(B # ax ) > e. Let B# C 
5 max. where B * is the equivalence class of a set in B. Then P*(B*) < 
P#(B# ax ). If B* G C*, then P*[B# ax ) < P#{B*) so we conclude that 
P#(B# ax ) — P#(B&). Otherwise, if B# 0 C # , then either B * = 0 or 
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B ^ ^ 0 and B& D A # ax ^ 0. This latter alternative is impossible since 
s Lx e C*, so B# ax n A# ax = 0, which implies n A# ax = 0. 

Thus B* C B$ ax implies B# = 0 or P*(B *) = P*{B* ax ) and thus 
B* ax is an atom. 

2.6.12. We show that iff B G cr(C), then there exists a countable family 
Cb C C such that B G ct(Cb). 

To see this, we let 

Q = {B C : 3 a countable family Cb C C such that B G <t(Cb)}. 
Properties of Q\ 

(1) fi G Q since for any countable subset C' C C, we have G <r(C'). 

(2) If B G G, then B G ct(Cb) implies B c G <r(C B ). Hence B c G Q. 

(3) If B n G Q then B n G v(Cb„) C <r(U «£#„), where Cs n is a countable 

family and hence so is U „Cb„. Therefore, G <r(\JCB n ) which 

implies (JB„ G Q. So Q is a tr-field. 

n 

(4) C C Q since if A G C then A G <x(A) and if we set C\ = {A}, then C\ 
is countable. 

Thus Q DC which implies Q D cr(C). 

2.6.15. To check 5x52 := (5 i52 : Si G 5,-, i = 1,2} is a semi-algebra we 
must check three postulates. 

1. 0 G Si for *=1,2 and therefore 0 = 0 n 0 G 5 i 52- Similarly, we may 
prove Q G <Si«f>2- 

2. If S 1 S 2 G S 1 S 2 and G S 1 S 2 then 

since SiSJ G 5i and S 2 S 2 G 52. 

3. For 5i G Si, i = 1, 2 we have 

(Si 5 2 ) c =Sf U 5 2 = StS 2 + SfS| + SjSJ 

l k 

= AijS2 + ^ Aij A 2 j + ^2 S 1 A 2i , 

J = 1 j,i i=l 

where we assumed 

/ k 

^ = T.M,. «! = !><■ 

j = 1 1=1 

This shows complements in 5 i 52 have the correct form. 
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To check that 

^(5 1 5 2 ) = ^(5 1 U 5 a), 

note that the left side is of the form 

i 

SuS2i, Su G Si,S2i G ^ 2 }. 

•=i 

Such sets as exhibited on the previous line are in >1(5! (J ^ 2 ) and therefore 

A(SiS2) Ot(5!|j5 2 ). 

Conversely 

5i [^J52 C «4(5 i52) 

and hence 

^iU-5 2 )C>1(5i52). 

2.6.16. Suppose { B n } are disjoint and B n G B. Then Yn B n £ B and 
B n ) c G B and therefore by assumption (c) 

1 =<?(£ Bn + (£ B n ) c ) = Q(Bn) + Q((Y BnY). 

n n n n 


However, we also have, from finite additivity, 

1 =Q(Y B n)+Q((Y B n) C )’ 

n n 


and -therefore 

r <?£>«) = £Q(S„). 

n n 


2.6.17. We check Ff~(y) is right continuous by showing that if y„ j. y, then 
FY(yn) 4- Ff~(y)- W this ' s n °t the case, then there exists L such that 

FY(y n ) 4 L > FY(y).t 

Suppose x is any value chosen so that 

L>x> FY(y). 

Then Ff~(y n ) > x implies by the definition of Ff~ that F(x) < y„ and 
therefore, by letting n — ¥ 00 , that F(x) < y. On the other hand, since 
x > Ff-{y), we have by definition that F(x) > y so we conclude F(x) = y. 
This means Ff~(y) > x which is a contridiction to the fact that x > F r <_ (y). 
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2.6.21. For a finitely additive measure // satisfying //(ft) = 1, it need not 
be the case that A„ 4- 0 implies fi(A n ) 4- 0. Use Proposition 2.6.1. Let 
ft = {1,2, . . ., } and let A = {E C ft : E or E c is finite. }. Define 


P(E) = 


0 , 

1 , 


if E is finite, 
if E c is finite. 


Then P is finitely additive. 

Let A n = {n, n + 1, . . . } € A since A ® is finite. So P(A„) = 1. Note 
A n 4- 0 but 1 = P(A„) -f* 0. 

2.6.23. Set 

C = {(— oo, *]:*£!}, 

which is a ^-system generating £?(M d ) and so if Pi = P 2 on C, then Pi = P 2 
on <r(C) = B(R d ). 
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Chapter 3 Solutions 

3.4.1. If 1^ G B, then 

A = i- 1 {i}eB. 

Conversely, suppose A G B. Then if /' is an interval, 

1 ^(/') = {w : U( W ) <E /'}. 

Consider the following cases. 

1. If /' D [0, 1], then = fi G B. 

2. If 0 G 7' but 1 £ 7' then l^T) - A c e B. 

3. If 1 G /' but 0 $. 7' then 1“ 1 (/ / ) = A G B. 

4. If 7' contains neither 0 nor 1 then 

1^(7') = 0 6 5. 

This suffices to show 1^ is measurable with respect to B by Proposition 

3.2.1. 

3.4.2. We have 

cr(X 1 )={0,fi} 

< r(A' 2 )=(r(l {1/2} ) = {0,n, {!},{!}«} 

<T(A 3 )={0,f2,Q,Q c } 

3.4.4. If A' G B/B( IR), then since {a;} G 7?(M),. 

, r’(W)Gfi, 

for aR x G £?(E). 

Conversely, suppose for all i € R that A -1 ({a;}) G B. Then for any 
B G B{ E), 

A -1 (B) ={w : X[w) £ 5} = {u : A» G 

= U {u> : x (u>) = r} 

ren,r£B 

= U X_1 ({ r }) 6 B - 

r£Tl,rZB 

3.4.5. The variable Y = F(X) is measurable by composition: 

A' : (Cl,B) (M,7?(®)) 

F :{R,B(R))^{R,B{ E)) 
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since F is monotone and hence measureable. 

Since F is continuous, P[X < x\ = P[A' < a;]. So from the properties of 
F*~ we have 


P[F(X) >y] = P[X > F*~(y)] = 1 - F(F^(y)). 


But 

F(inf{u : F(u) > y}) = y 

when F is continuous. 

3.4.8. We write 

Z — XI a + Y1 A c. 

If A € B then 1,4 and l A <> are both random variables by 3.4.1. Products of 
random variables are random variables and sums of random variables are 
random variables. This suffices. 

3.4.11. X t is a random variable since for fixed t, X t = 1{ ( } and {t} is 
measurable. So 

We claim 


LHS= \/ a(X t ) 
te[ o,i] 

={A C [0, 1] : A is countable or A c is countable.} = RHS. 


Let 

c = {0,fi,{<},{t} c ; te[o,i]} 

;so that 

=' LHS = <t(C) = \J <r( X t ). 

«e[ o,i] 

Clearly RHS C LHS since the LHS contains one point sets and is closed 
under countable union. 

Likewise, A 6 C implies that A € RHS so that LHS C RHS. 

3.4.12. To show that monotone / is measurable it suffices to 

show that 

{u : f(u) < a;} = £?(M). 

However, by monotonicity, the left side is a semi-infinite interval which is 
certainly a Borel set. From Proposition 3.2.1 or Corollary 3.2.1, this suffices. 

3.4.14. The function / is use iff {< : f(x) < a} = / -1 (-oo, a) is open in 
R. If C = {(-oo, A) : A E R), then <t(C) = 5(R) and C B(R). This 

means / G 5(M)/S(K). 
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3.4.15. Let f(x) = l( a ,6] and define 


fn(x) 


1, if a + i < x < b, 

< 0, if x < a, or a; > 6 + i, 

linear, otherwise. 


For x E (a, 6], f[x) = 1 and f n (x) = 1, provided n is so large that a+£- < x. 
Fora; < a we have /„ (a;) = f(x) = 0 while for a: > b we have f(x) = f n (x) = 
0 provided b + L < x. 

3.4.16. If B(M) C B and / is continuous, then / is measurable so 

/■'WcBWcB 


and therefore / E B. 

Conversely, suppose for any continuous function / that we have / E B. 
This implies by definition that 

r'WDcB. 

This says that for any A E /?(IR) 

{x : f(x) E A} E B 

for any continuous function /. Let f(x) — x and the previous display reads 
A E B. This means B(IR) C B. 

Now let T = E C(ffi)) be the smallest cr-field containing all con- 

tinuous functions on R. From the previous discussion, we get 

B(R) C T. 

But ff / is continuous, / is #(M) measurable. So if any continuous function is 
B(M) measurable, the smallest <r- field generated by the continuous functions 
must be contained in £(M). Hence T = H(M). 

3.4.17. Start by assuming T E B/B'. Then for B' E B' , we have 
T-^B') = {uj E A n : T n {u) E B'} = A n fl T~ l (B') E B n . 

Thus T~\B') C Bn. 

Conversely, suppose for each n that T n £ B n /B' . Then for B' £ B' we 
have 


T~ l {B') ={ w : T(u) E B') = (J{ w £ A n : T(u) E B'} 

n 

=LK W € An : Tn(u) E B'} = (J T~\B'). 

n 


n 
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Since T n l (B') G B n C B, we have T 1 (B') G B. 

3.4.19. Suppose first that .Y = Y o T and we show X G <r(T). For any 
A G B(M), we need to show 

X~\A) G <r(T) = {T -1 (5 2 ) : S 2 G B 2 }. 

This follows from 

x-'iA) = r-^y- 1 ^)) 

since Y~ l {A) G B 2 . 

Conversely, suppose A' G <r(T) which means that for all A G B(R), 
X~ 1 (A)e{T- 1 (B 2 ) :B 2 eB 2 ). 

Suppose, for simplicity, that .Y > 0, since otherwise we would just split X 
into positive and negative parts. Then we write 


and for some sets Bk n i B n G B 2 the above equals 


" 2 " k - 1 


and thus for any uq G fii 


Define 


and 


k — 1 

X(u>i) = ^lirn, t X ~^r^B k ATui) + nlsjTw!). 

fc= l 

n2" k _ 1 

^n(w 2 ) = X 0 „ 1 B*n( w 2) + «ls„(w 2 ), 

k = l 

Y — limsupy„. 

n-foo 


Then X = Y oT as required. 
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Chapter 4 Solutions 

4.6.2. We use the following useful notation. If A is any set, define 

2l (0 >=A c , A (i ) = a. 

We need the fact that if Bi, . . B n are independent events, so are 
B^ £l \ . . . , B^ e ^ for any choice of e := (fi, . . . , e n ) £ {0, l} n . 

Suppose Bi, . . . , B n are independent subsets of a space satisfying 

1 > P(Bl ei) ) > 0; e,-€{0,l}, i=l,...,n. 


Then 

P(f]B^) = flP(B^)>0, 

i=l t = l 

implies p)” =1 ^ The sets 

n 

: (£!,...,£„) £ { 0 , 1 }"} 

f = l 

partition fi n . So if |^4| is the cardinality of A, 

l«»l = E I Pi ^ Ci) | > K0, 1}| = 2", 

£6{0,1}" i = l 

since p| t . =1 ^ 0 and hence must contain at least one sample point. So 

having n independent events, requires the space to have at least 2 n sample 
points. 

It'is easy to see that 2" is really the correct minimum number. Let 

fin = {0,l} B , />((£!,...,£„)) = ^ 

for all « = (fi , . . . , f„) G and set 

Bi = {e : €i -- 1}. 

Then Bi,...,B n are independent and 1 > > 0. Since |Q n | = 2", 

we conclude the sample space cannot contain fewer than 2" points if n 
independent events exist. 

4.6.5. (a) If X is independent of itself, B(X) is almost trivial. Therefore, 
since X € B(X), we have that there exists c 6 M such that 


P[X = c] = 1 . 
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(b) If X is independent of g(X), then g(X) is independent of ^(A') and 
hence by (a), there is some c such that P\g(X) = c] = 1. 

4.6.6. We have on the one hand that 


P[ Xi <x u ...,X n <x n ] 

1 = 1 

for all Xi £ M, i = 1, . . . , n. On the other hand, 

n 

^[■^7r(l) ^ j • • • i ^n(n) ^ *^n] — 


* = 1 


SO 


(Xi, . . X n ) — (XttJi), . . . 
4.6.11. Pick c n to satisfy 


P[\Xn\ > c n /n I < JL, 


so that 


£ p 


^,>i 

Cn n 


< oo. 


By the Borel-Cantelli lemma, P > L i.o. = 0, and therefore 


1 = P{liminf[| — | < -]} < P{ lim I — I = 0}. 

n-voo C n 71 “ n-foo c n 


4.6.12. Given any e > 0, a n /b n ->■ 1 means 

6„(1 - e ) < a n < 6„(1 + e ), 
for all large n, say n > n 0 — n 0 (e). Therefore 

^ 6„(i - e) < a n < bn + c ) 

n>T2 0 n>no n>no 

and the result follows. 

4.6.13. Let 

(Bi, B 2 , . . ■) = {A\,A^, At, . . .) 
so that {B n } are independent events. Also 


P(B n ) = P(A 1 ) = p 2 q 
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so that J2P(B n ) — p 2 q = oo and by the Borel 0-1 law we have 

P(B n i.o.) = 1. 


Since 


limsupl?„ C limsupyln 

n-+oo n— hoo 


we have 


1 = P(limsupB„) < P(limsupA„). 

n— foo n— ►oo 


4.6.14. For n > 1, define the events 

2"-n 

An = [J [-^2 n +j = 1| • ■ •!'^2»+j+n-l = l,X 2 "+j+„ — 0]. 
j= 0 

Taking complements we have 

2"-n 

A„ = f') [^2“+j = 1, • • • , X2«+j+ n -l = 1,^2 n +j+n = 0] C 
3=0 


and retaining only certain terms in the intersection gives 


A„ C[A2»+o — 1, ■ • - , .Y2»+n-l = 1, AV+n = 0] C 

P'|[A'2"-)-n-(-l = 1, • • • , ^2” + 2n — 1, A2>* + 2ra + l = 0] C 
f')[-X’2"+2n+2 = 1 1 - - - , A2"+3n + l = 1 > ^2 n +3n + 2 = 0] 

: n-. 


which is the intersection of events depending on disjoint blocks of A’s and 
which are therefore, by the groupings lemma, independent. So P(A C „) < 
fl(l ~P n q) where the number of terms in the product is the number of dis- 
joint blocks of length n + 1 which can be crammed in the interval [2", 2 n+1 ]. 
This is about 

2 n+ i - 2 n _ 2"(2 — 1 ) _ 2 n 

n + 1 n + 1 n+1 

Therefore, 


P(A c n ) <(1 - p n q) 2n/n+1 

and using the inequality 1 — x < e~ x for 0 < x < 1 

P«) < exp { —qp n “ ~T } = exp{-,M^ 
n+1 n+1 
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which leads to 


P(A n ) =1 - P(A%) > 1 - exp{- 9 M%. 

n + 1 

Now {,4„} are independent, so to prove P(A n i.o.) = 1 we must show 
E n p ( A n) = oo. For p = \ 

HZ P M) > - ex p{--^-}) = oo 

„ — n + 1 

n n 

since 

. -in. l/z 

1 — e »+i ~ n —¥ oo 

n+ r 

which is not summable. For p>|we also have 2» > 1 and ^r- -4ooso 
En P \ A n) = OO. 

4.6.15. If S(n ie/ ^) = n, € /^) whenever Yi G Bi, then for any A{ G 
Bi, take Yi = 1^, and 

*) = p (D a <) = n p M = n ew 

i€i iei iei 

and so {A it i G 1} are independent and {B it i G /} are independent c-fields. 

Conversely, suppose {Bi,i G / } are independent cr-fields. For Ai G Bi 
and Yi = l^ t we have 

i'€/ i€l 

Next, if {Yi, i G I } are simple, then suppose 

= Aij G Bi . 

j 

We then have 

«(n«) =«(iie*w)'^») 

*'e/ ie/ j(i) 

=E { HZ IKfl>ln*„(„) 

j(f), »€/»€/ 

= hz nwOiM 

j(i),ieli£l *€/ 

= hz 

= n hz x 'j( i ) p (Ai,j(i)) 

=nw)- 

* 6 / 
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(If the notation makes following this difficult, write out the argument as- 
suming that I = {1,2}.) 

Finally, if 1} is a general, non-negative f?,-measurable function, there 
exists y; (n) G B{, such that is simple and 0 < t Y). It then 
follows that 

i€l i£l 

and by the monotone convergence theorem 

£(n^ (B) )t£(ii y o 

iei iei 

and from the previous step, the left side is 

n^ (n) )tn^). 

• 6 / »'€/ 

again using the monotone convergence theorem. 

(b) If for example B\ is independent of B^ and 5 t - D B\ for i = 1,2, 
then i = 1,2 are independent since if Ai G B[ then Ai G Bi and 
hence Ai,A 2 are independent. So if X t ,t G T are independent, then by 
definition cr(X t ),t G T are independent and since a(f(X t )) C <r(X t ) the 
result follows. 

4.6.16. Kolmogorov’s 0-1 law implies that P[X n converges] = 0 or 1. If 
P[A' n converges] = 1, then there exists c G [— oo, oo] such that P[X n — > c] = 
1, since Iimn^oo X n is a tail random variable of an independent sequence 
and is hence almost surely constant. Suppose |c| < oo. (Modest changes 
are necessary if c = ±oo.) Then for any e > 0, 

: P[X n G {c-e,c + e) c i.o.] = 0, 

so by Borel’s 0-1 law, 

oo > ^2,P[X n G (c - e, c + e) c ]. 

n 

Since {A„} and iid sequence, we have 

P[X n G (c - e, c + e) c ] = 0 

(otherwise, the sum would diverge since the sum consists of equal terms by 
the iid assumption) so 


P[X i G (c — e,c + e)] = 1. 

This is true for any e > 0 so let e | 0 to get P[X = c] = 1. This contra- 
dicts the assumption that the sequence does not consist of constants with 
probability one. 
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4.6.17. (b) If TV is a TV(0, 1) random variable, we have 

P[\N\> (1 ±e)s/2 log n] =2P[7V > (1 ± £ ) 

0 exp{-((l ± £ ) 2 21ogn/2} 

(1 ± e)y/2 logn 
_ c 

7j( 1±£ ) 2 -\/log71 


Therefore 

^P[|TV| > (1 + e)\/ 2 logn] < oo, ^P[|TV| > (1 - s)\j2 log n] = oo, 

n n 

arid 

P [ -©= > (1 + e)x/2 i.o.] = 0, P[-pL > (1 - £ )x/2 i.o. ] = 1. 
Vlog« Vlogn 7 J 

Thus 

P[limsup-j^L = \/2] = 1. 

n— f oo \/iO£> ft 

(c) Let X have a Poisson distribution with parameter A. Since 

OO 

P[X > n] = Y,e~ X V/j'. > e~ x \ n /n\, 

j— n 

we merely have to prove the upper bound. 

We use the relation between the Poisson distribution and exponential 
distribution. Let {E n ,n > 1} be iid unit exponential random variables so 
that {E n /\,n > 1} are iid exponential random variables with parameter 
lambda. In the time interval [0, 1], a Poisson process of rate A has at least 
n points iff the time of the nth occurrence is before time 1. Therefore 


n 


n 


P[X > n ] =P[J2 Eil A < 1] = P[J2 Et < A] 



,n — 1 


(n-l)! 


du 


i=i 


and since e u < 1 for u > 0, we get an upper bound 

f x u n - 
<!• / 7 

Jo 


,,n — 1 \n 

iy du =^ 


as needed to be shown. 
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We show now that 


Pflimsup ■ 


X n 


n-^oo log nj log 2 n 
where log 2 n = log(logn). It suffices to show 


= 1 ] = 1 . 


Y^P[Xn > a(Iogn/log 2 n)] 


< oo, 
= oo, 


if a > 1, 
if a < 1. 


Set m(n) = [a log n/ log 2 n\ and note 


P[X > m(n)] 


A m ( n ) 
~ m(n)\ 


and applying Stirling’s formula to the denominator, this expression is as- 
ymptotic to 

A m (”) _ / Ae \">(n) i 

e -m(n) m ( n ) m (n)+i/2 C \m(n)) yjm(n) 

exp{— m(n) log(m(n)/A)} 

\/m(n) 

=cexp{-alogn(l - loS2 ”> ) } 1 =. 

log 2 n / Q J°g’} 

V lo S2 n 

Since a > 1, we may find a > a' > 1 and n so large that 

a[l - log(A log 2 n)/ log 2 ] > a' > 1. 

Then we get an upper bound for the tail probability as follows: 

^,exp{— a' logn} _ 1 

“ , In lo K n 

V lo g2« y a ]og 2 rj 

When a > o' > 1, this is summable. 

Similarly, when a < 1, one gets the probability sum appearing in the 
Borel 0-1 Law to diverge. 

4.6.18. Set Ci = {/!}, and Ci = V and it follows that C\ is independent 
of Ci- This implies that B{C\) is independent of Bfa)- Therefore, A is 
independent of A and P(A) = 0 or 1. 
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4.6.19. Let fi — {0, l} 2 . Define X\(i,j) = i, X 2 (i,j) 
{0, l} 2 . Now define Pi and P 2 by 


j for (i,j) e 


Pi 

P2 

Then under Pi, we have Xi independent of X 2 but not under P 2 since 

JM*i = 0,X 2 = 0] = P 2 ({0,0})=± 

and 


( 0 , 0 ) ( 0 , 1 ) ( 1 , 0 ) ( 1 , 1 ) 


1 

1 

1 

1 

4 

4 

4 

4 

1 

i 

1 

1 

2 

a 

8 

4 


P 2 [X 1 = 0]P 2 [A 2 


0] =p» ({(0, 0), (0, l)})p 2 ({(1, 0), (0, 0)}) 

=(- + -)(- + -) = -■- = — 
v 2 8 m 8 2 ; 8 8 64 F 2‘ 


4.6.20. (c) Note that 

P[XiX 2 = 1] = P[Xi = \,X 2 = lox Xi = -1,X 2 = -1] = i + - = - 

4 4 2 

and similarly P[XiX 2 = —1] = 1/2. Then A - ,- is independent of A'iA 2 , for 
i = 1,2. To see this, note 


P[XiX 2 = 1,*! = 1] =P[Xi = 1,A' 2 = 1] = i 

=P[. XiX 2 = 1]P[X! = 1] = (I)(i) = i 
and similarly for other possible values for the mass function. However, 
P[X x = 1, X-i = l,XiX 2 = -1] = 0 ?£ P[Ai = 1]P[A' 2 = l]P[XiX 2 = 1] 
and thus X\, X 2 ,X\X 2 are not independent. 

4.6.22. Pick any J C {1,2, . . .} and define 


A n , if n £ J, 
A c n , if n£j c . 


Then {B n } are independent and ]T) n P(B n ) = oo so we conclude from the 
Borel 0-1 Law that 

P(B n i.o. ) = 1. 
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Taking complements, this also means that 

° = p ^s f ■ B »> = ^ n ^)- 

k>n 

Interchange the roles of J and J c and we may conclude 

0 < lim t P( D b k) = 0. 

n->oo 1 1 

k>n 


Therefore, for all n, 

P(f) B„) = 0. 

k>n 

For the purposes of getting a contradiction, suppose B is an atom so that 
P(B) > 0. Define J in the following particular way: 


J :={n> 1 : P(A n B) > P(A c n B)} 


and as above, set 

B = < An ’ if ” e 

, if n e J c . 

Note with this definition, that P(B n B) > P(B„B). Therefore, since 
■P{B) = P(B n B) + P(B c n B ) < 2 P(B n B), 

we conclude 

0< \P{B) < P(B n B). 

Now, B n B C B and since B is assumed to be an atom, either P{B n B) = 0 
(which cannot be the case since we know P(B n B) > \P{B) > 0) or else 

P{B n B) = P(B). 

This last equality holds for all n. Since P(B) > 0 we have for the conditional 
probability measure 

P(B„\B) = 1 

for all n and hence for any n 

P(f| B k \B) = l. 

k>n 


P(f) B k B) = P(B) > 0. 

k>n 


Therefore, for any n, 
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(b) We have 

P[l„ — k] = P[d n — 0, . . . , d n+ k - 1 = 0, d n+ k = 1] = 

Note 

[Z n > r] = P[d n - 0, . . . , d„ +r _ i = 0] = 2~ r 
which also shows that 

\ln ^ 7*] G c(dn , . . . , C?n+r— l)* 

(c) This follows from [/„ = 0] = [d n = 0] and the fact that {d„} is iid. 

(d) From the Borel 0-1 law, P{[l n — 0] i.o. } = 1 iff 

°o = £p[/„ = 0] = £l 


(e) Note 


]}2n — 1] — [d-in — 0,d2n + l — 1] G ^2n + l) 


and by the groupings lemma, the sigma-fields <T(d. 2 n,d 2 n+i) are independent 
for different n. Since 


]r>[/ 2 „ = 1] = =«>. 

n n ' ' 

P{[hn = 1] i.o. } = 1 and hence P{[/„ = 1] i.o. } = 1. 

(f) We have 


P V n - + £ ) lo S2 n ] < XI P \- ln > K 1 + f ) lo S2 «]] 

n n 


=?(0 


[(l+e) log 2 n] 



(1+0 log 2 n+$(n) 


where |0(n)| < 1. This series converges or diverges according to whether 
J2n converges or diverges but this series converges. 

Therefore, by the Borel-Cantelli lemma, for any e > 0, 

P{[ i^TT ^ 1 + £ ] i-o. } = 0. 

I°g2 71 

This means for any e* 4- 0 

P[limsup — — — 

n— hoo 10g2 ^ 


< 1 + €fc] = 1 
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and intersecting over k 
,P{P|[Iim sup 


— — < 1 + ffc]} = P[limsup — — — < 1] = 1. 

n — ► oo *^§2 ^ n-+oo 1®&2 ^ 


(g) Let r(n) | oo be a sequence of integers. In particular, we will let 
r(n) = [log 2 n] . Define n(l) = 1, and n(A; + l) = n(k) + r(n(k)) . Then since 

\l n > f] G <j(l n ,l n + 1 , ■ • • , ln+r— l) 

we have from the groupings lemma that 

l l n(k) > r(n(k))] Gcr(d n(kh ...,d n(k+1) _ 1 ), 
and therefore these events are independent. If we show 
^{[^n(fc) > r(n(&))] i-o. } = 1 
then it will also follow that 

P{[l n > r(n)] i.o. } = 1. 

It suffices to show 

Y. P[ l n(k) > r(n(k))} = oo. 

k 

Since n(k + 1) — n(k) = r(n(k)), we have 

X>[/n(fc) > r(#))]ryr r W fc )) = J22- r{n(k) ) n{k + 

k k k- r ("(*)) 

and because r(n) is non-decreasing, this is bounded below by 

n(* + l)-l (n) 

>V V — - 

• 1 ^ j v(ti) 

k n=n(k) 

o — r(n) 1 

=y 2 =y- 1 

k r(n) ^ n\og 2 n 


= OO. 



Chapter 5 Solutions 


5.5. (b) We use Fubini’s theorem. Let A = {a 1 , 02 , . . .} be the countable 
set of atoms of F. Write 

E(F(X)) = f F(x)F(dx) = f ([ F(dy)) F(dx) 

«/K «/R \JyKx / 

= ff F(dx)F(dy) = f (f F(dx)) F(dy) 

J J — oo<t/<a?<oo Jy€l& \Jx>y / 

= f ([ F(dx)) F(dy) + f (f F(dx)) F(dy) 

•'yZA \Jx>y J Jy£A c \Jx>y J 

= E (U - F {v)) + F ({v})) + f (1 - F(y))F(dy) 

y£A Jy€A c 

= £(! - F(y))F({y}) + f (1 - F(y))F(dy) + £ F 2 ({j/}) 

y€A Jy€A-= y€A 

= f (1 - F(y))F(dy) + £ f 2 ({y}) 


=1 - ^(^(A-)) + 53 -P 2 ({w})- 

y€A 


Summarizing we see that 


and therefore 


or 


E(F(X)) = 1 - £(FP0) + Y, F2 (^}) 

y6A 

2E(F(X)) = l + YF 2 ({y}) 

y€A 

£ ( F(A ')) = ^ 1 + E F2 ({2/})j • 

5.10.6. (e) Note that 

I f XdP — f XdP\ =|£(*UJ - E{XU ) | = | E(X(l An - 1 A ))\ 

* A n J A 


<E(\x\\i An - Ul) = E(xi AnAA ) -4 0 


by the result in (b). 
(a) Since 
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without loss of generality we may (and do) suppose X > 0. Now X\x> n -»■ 
0 as n -4 oo and 

0 < *l [x>n] < X G L x 
so by the dominated convergence theorem 

I XdP = EXlx>n E0 — 0. 

Jx>n 

(b) If P(A n ) -4 0, then assuming X > 0 we have for any large M 

f XdP = f XdP + f XdP 

JA n J A n [X<M) Ja„[X>M] 

<MP(A„[X <M])+ [ XdP 
J[X>M] 

<MP{A n ) + f XdP. 

JX>M 


Therefore 


>x>M 

limsup / XdP < 0+ f XdP. 
n-yoo J A n JX>M 


Let M - 4 oo and by (a) we have J x> m XdP -4 0. 

(c) If P(A D [|A'| > 0]) = 0, then with A n = A fl [|X| > 0] we have 

f \X\dP — f \X\dP 
Ja Ja„ 

and since P{A„) = 0 we apply (b) and get 

0= lim [ \X\dP= f \X\dP. 

: n ^°° JA n Ja 

Conversely, it suffices to show that £’(|A'|) = 0 implies P[|X| = 0] = 1 
(since then one can replace X by Xl^). Recall 


n 2" 


I v I V k — 1 ■ 


fc=i 


so taking expectations gives 


n 2 ” 


o = B(|X|) > £ e [^~r . 4)] + »m\ > »]• 


k = l 


Therefore for 2 < k < n 2 n 


P [[\ X \ e [^-,^)]=0 = P [\ X \> n ] 
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and we get by summing over k and adding the last term that P[|X| > 
2 - "] = 0. Let n — ► oo to get P[|X| > 0] = 0. 

5.10.7. We have \X n — X\ < 2K and the constant function 2A' is in L i. 
Therefore by dominated convergence, — X\ — > 0 implies that E\X n — 
X\ ->0. 

5.10.9. We have 


f F(x + c) — F(x — c)dx — f f F(du) 

J — oo «/R Ju€(x — c,r+o] 


dx 


= f d(F x A) 

Jx — c<tz<r+c 

= [ ([ X (dx)) F(du) 

Ju \Ju— c<r<u+c / 

= J 2 cF{du) = 2c. 


5.10.10. Define 


k 

X n = 2^1[^i< X < Jk-] + 00 • 1 [A'=oo]- 

fc — 1 

Note X * > X, X * is non-increasing and for w such that X(u) < oo we 
have 

sup KW-xw)<r. 

wg[A'<oo] 

If E(X) = oo, then oo = E(X) < E(X*). If E{X) < oo, then P[X = 0] = 0 
and then 

; E(x:) = E{(X* - X) +X) = E(X' n -X) + E(X) E{X), 

since 0 < E{X* n - X) < 2~ n -)■ 0. 

5.10.11. Since X £ <r(X) and l[ygB] £ &{Y) we have 

f XdP —EXI[y^b] = E(X)E{\[y^b]) 

J[Y€B] 

(from, for example, Problem 4.6.15) 

=E{X)P[Y £ B]. 

5.10.12. (a) We first verify that B x B is generated by vertical and hori- 
zontal lines: 


(*) 


B x B — a({{a:} x X,X x {a;},Va: £ X}) := X. 
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To see this note that {x} x X is a rectangle so 

{ 2 } x X £ B x B, X x {z} G B x B, 

and hence 

B x B = cr(RECTS) D cr({x} x X, X x {x},Vx € X) = X. 

To get a reverse containment let A G RECT. Then A = Ax B where either 

(1) A is countable and B is countable. 

(2) A is countable and B c is countable. 

(3) A c is countable and B is countable. 

(4) A c is countable and B c is countable. 

For 

(1) Ax B = U^exi {(a;, J/)} £ X. 

y€B 

(2) A x B = U W x B = U {*} x X\ U {(*,»)} £ X. 

x£A x£A y€B c 

(3) We use an argument similar to the one used in (2). 

(4) (A x B) c = A c x X U B c x X £ X. 

So RECT c X and <r( RECT ) c X. 

Now combine (*) and Exercise 2.6.12 to get the following statement: If 
E G B x B, then there exists a countable set S C X such that 

E G <t(({s} x X,X x {s},s G S) =: T. 

Let V = {{s}, s G 5; S c } so that V is a partition of fl. Then 

V xV := {Ai x A 2 : A,- eV,i= 1,2} 
is a partition of A' x X and 

X = a(V x V) = {{J Aj xA fc :/c{l,2,...} > / / c{l,2 ) ...}} I 

J'6/, 

*£/' 

where the last equality follows because V x V partitions X x X. 

So if E G T , then 

E = |jAj x A fc , 

i.fc 
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where j, k range over a subset of integers. But Aj x A k = {(s,-, s^)} or 
{s,} x S c or S c x { Sj } or S c x S c . If E = DIAG then E £ T is impossible 
and we have a contradiction. 

5.10.14. We proceed by means of a series of steps to show 

Eg(X)=Eh(X,Y). (#) 

Step 1. If h(x,y) = hi(x)h 2 (y) then ^(a:) = hi(x)E(h 2 (Y)) and 
E(g(X)) =E(h 1 (X))E(h 2 (Y)). 

Thus (#) holds. It also follows that (#) holds for h(x,y) = l^(a:)l B (y) = 
1 axb{x, y) where A,B £ B(M). 

Step 2. Let 


G := {A € B( K 2 ) : (#) holds for h = 1 A }. 

Note the following properties of Q: 

1. 

2. If A € G, then A c G G since 

1 - Eg(X) = 1 - E1 a (X,Y) = E( 1 - l A (X,y)). 


3. G is closed under countable, disjoint unions. 

We conclude G is a A-system. Also G contains S = {A x B : A, B £ 
the 7r-system of measurable rectangles. Since Step 1 implies 

G D S, 

we get from Dynkin’s theorem that 

G D a(S) = B{R 2 ). 

We conclude that (#) holds for 1 A whenever A £ B(R 2 ). 

Step 3. Thus (#) holds for all positive simple functions and for all 
positive measurable functions. 

5.10.15. (a) We have 

nE =E ( £l[i>*]) < P[1 > j] 

=P[X > n] — »■ 0, n —¥ oo. 
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(b) Now we have for any jj > 0, 
n ~ lE (^ ![*>*]) =E (^l t i>^,A'>o]) 

=E + E ^ 

=A + B. 

For A we have the bound 

A < -Pt 1 > > rj,X > °] = P[1 < nX < r)~\X> 0]^0 

as n — X oo. It should be clear that B < i) and since rj is arbitrary, we are 
done. 

5.10.16. (b) If Xi and X 2 are independent, then fi{X x ) and f 2 (X 2 ) are 
independent and 


Efi{X x )f 2 {X 2 ) = Eh{X x )Ef 2 {X 2 ). 

Conversely, suppose Ef{X x )g{X 2 ) = Ef(X x )Eg(X 2 ) for all bounded 
continuous /, g. Let /,■ = l( a , ,6,],i=i , 2 • Choose bounded continuous fn ’ as 
in (a) and then it follows that. 

Ef^(X x )f^(X 2 ) = f?/W(Xi)£/< 3 >(X 2 ). 

Let n — ¥ 00 and use the dominated convergence theorem to get 
Efi(X!)f 2 (X 2 ) = Eh{X x )Ef 2 (X 2 ) 
which is equivalent to 

P [Xi G (ai, 6i], X 2 G [a 2 , 6 2 j] = P pC G [ai, ii]] P [X 2 G [a 2 , & 2 ]] 
This:suffices for independence. 

(c^ By two applications of dominated convergence, we get for /i,/ 2 
bounded and continuous 

E(fi(Zoo)f 2 [r)oo)) = lim E (f x (£„)/ 2 (j 7„)) = lim E(f 1 ^„))E(f 2 (rj n )) 

n — ► 00 n— >00 v 7 v ' 

=E{f 1 (Z 00 ))E(f 2 (r }oo )). 


5.10.18. The Riemann integral over A would give us the area of A. Write 

JJ d(X x A) = JJ l A d{ X x A) 

= \ l {(x,y)€A}{y)Hdy) X (dx) 

“'[0,1] [•'[ 0,1] 

= l [ [ iA x {y)dy X {dx) 

•no. n uo 



(where the inner integral is interpreted as a Riemann integral) 

l{x)\(dx) 


=/ 
J rc 


[ 0 , 1 ] 

where l(x) is the length of a vertical line segment which passes through A 
at x. Note l(x) is bounded, continuous and hence Riemann integrable so 
the above equals l(x)dx, the area of A. 

5.10.20. (a) Use the transformation theorem. 

(b) If 0(A) = 0 then E(e xx ) = 0, which implies exp{AAf} = 0 almost 
surely. This means that either X = -oo almost surely if A > 0 or X — -f oo 
almost surely if A < 0. So assuming X is M-valued as is usual, we get 
0(A) > 0. 

Now suppose A £ A 0 . Pick e such that [A-e, A+e] C A. Suppose A„ -> A. 
For all large n 

e U< e (M^ + c (W gil ( f ) 

e"'' and by dominated convergence we get 


A, e XnX ^ 


and since A„ — j 
Ee XnX -» Ee xx . 

(c) Let 

f(x) = c(l + x) a e~ x , x > 0. 

Then A,*, = 1. If a < —1, then / 0 °°(1 + x) a dx < oo so A TO £ A. 
If a > —1, then / 0 °°(1 + x) a dx — oo, and thus Aqo £ A. 

(d) The density is 

e x *f(x) 


h(x) = 


m ' 


(e) We have 


FM =f, 


e Xx F(dx) 

~Xx 


- sup a7y\ F ( I ) = ° - 

x£l 0(A) 

5.10.22. We use Fubini’s theorem to interchange the order of integration: 


f p [ x > t]dt = [ 17 l(t,oo)(*(w))<*P 

J[ o.oo] 7[o,oo] Usi 


dt 


-L 


[0,oo]xfl 


l (ti0o) (X(w))P X A (du,dt) 
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5 . 10 . 25 . (a) If y „ — » 7, then since' g is continuous, we have g(X — y n ) — ► 
g(X — 7). Since g is bounded we get by dominated convergence that 

<?H 7 n) = Eg(X - 7„) Eg{ X - 7) = <j>{y). 


(b) We have 

lim g(X - 7) = g(-oo) = - 1 . 

7— bOO 

Apply dominated convergence to get <p(y) — ► — 1 as 7 -4- 00. 

(c) If 71 < 72 , then X — 71 > X — 72 and since g is increasing we get 
g(X - 71) > tf(A - 72) and <£(7!) > <£(72). In fact <j> is strictly monotone: 
If 71 < 72 and <^(71) = <^(72) then 0 = E(g{X - 71) -g(X — 72)) and since 
the integrand is non-negative, we get g(X - 71) - g(X - 72) = 0 almost 
surely. Since g is strictly monotone we get a contradiction. 

This shows (d) since <^(7) = 0 must have a unique root. 

(e) To show j(X + c) = y(X) + c, note y(X + c) is the unique root of 

E(g(X + c- 7) = 0 , 


which means it is the root of 

£( 5 (A + c- 7 (A + c))) =0. 

Also, 

E(g(X + c) - y{X) - c )) = e[ 9 {X - 7(A))) = 0 , 

so by uniqueness, y{X + c) = 7(A) + c. 

(f) If <;(— x) = — g(x), then 7(— A) is the root of 


0 = Eg(- X - y(—X)) = -Eg( X + 7 (-A)) 


and since also Eg( X — 7(A)) = 0 , we get by uniqueness that 


7(A) = — 7 (— A). 


5 . 10 . 30 . We have Y„ — A n > 0 so using Fatou’s lemma 
E(Y) - E( X) =E(Y - A) = £(liminf(y„ - A n )) 

n— boo 

< lim inf E(Y n - A„) = liminf£;(y n ) - £(A n ) 

— n-voo n-voo 

= liminf£(y) - E( X n ). 

n- 400 


Therefore 

lim sup E(X n ) < E( A) 

n— boo 

and again applying Fatou’s lemma we get 

E( A) = £'(lim inf A„) < liminf^A^) < limsup£'(A„) < E{ A). 

n— boo n-boo n— boo 
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5.10.31. (c) Suppose I = [a, 6] and P[X £ /] > 1/2. For any e > 0, 
P[X < a — c] < 1/2 and therefore a — e cannot be amedian. Similarly 6 + e 
cannot be a median. 

(d) Observe that 


P[X e[E(X) - v / 2Var(X), E{X) + V / 2Var(X)]] 
=P[|X-£(A)| < v / 2Var(X)] 

and therefore by Chebychev’s inequality 


P[\X - E{X) | > v/2Var(X)] < 


Var(X) 

(\/2Var(X))2 


1 

2 ' 


Thus if 

/ = [£(X) - V^Va^X), E{X) + V / 2Var(Y)], 

we have P[X £ /] > 1/2 and by (c), a median is in I. 

5.10.36. Suppose that X n e L 1} X n f X, and V n £'(.Y n ) < oo.. We first 
show that X e Li. Since X n t X, we have X~ > X“ +1 > X~ , so X x £ h 
implies E{X~) < i?(Xf ) < oo. 

Also 


£(X + ) =£ , (lirninf X+) < lim inf£ , (A^ _ ) 


(by Fatou’s lemma) 


= 1 ™m f [^(A+) - E(X ~ ) + E(X ~ )] 

=' <\/E(X n ) + E(X^) < oo. 

n 

Thus X £ L\ and 0 < X — X n < X £ L\ and X — X n -4 0 imply, by 
dominated convergence, that 

E(X-X n ) = E{X)-E(X n )^0. 
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Chapter 6 Solutions 

6.7.1. (a) If {X„(w)} is monotone, lim A„(w) exists. Call the limit X(w). 

n— >oo 

p 

If X n — >■ X there exists a sequence {rij} such that X nj (w) — >• X(u) for 
almost all w. Thus lim X n (tj) = X(u>) for almost all w. 

n-y oo 

(b) From the definition of convergence, X n (w) — > X(u) iff 

£n(w) = sup|X*(w) - X{u)\ -► 0. 

k>n 

However since {£ n (w)} is monotone, we may use (a). 

(c) Since {y n } is non-increasing, we need only show convergence in proba- 
bility. Let the n points be {exp{27n'0j}, j = 1, . . . , n} where {0j, 1 < j < n} 
are iid U(0,1). Then 

[Y n > e] c[ there is an arc of length at most 1 — e 
such that n points are in it ] 

C[ within a (1 — ^-neighborhood of some point, 
there are n — 1 points ] 

n 

c(J[ within a (1 - ^-neighborhood of e i 2 * * * * ,Sj , 

j = i 

there are (n — 1) points ]. 

Therefore, 

P[Y n > e] <nP[ within a (1 — ^-neighborhood of e 2lr,ei , 
there are (n — 1) points ] 

=n(l — e) n-1 ->• 0. 

(d) : We have {M„} non-decreasing, so it suffices to show convergence in 
probability. For x < xo, 

P[M n < x] = F n {x) ->• 0, 

since F(x) < 1. 

6.7.2. We have by the weak law of large numbers (which only requires 
existence of the first moment as will be shown in Chapter 7) 

i (£(*•■ - * 2 )) = ^E X ?- X 7 $ E ( x i) - (ZXi ) 2 = * 2 - 

\i=l / 1=1 

6.7 A. We have that {S„} is L 2 convergent iff {5 n } is L 2 cauchy iff 

ll-S'n. - S m \\l = Var( a.iXi)=<T 2 ^ a 2 -»• 0, 

» = m+l *=m+l 
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as m, n -*■ 0. The last statement is true iff {5D"=i a j } is cauchy which holds 
iff {£"=!<*"> 1} is convergent. 

6.7.5. Given {-Y n } iid, X„ G L\, we show that {S n /n} is ui as follows. 
Note first that 

su P^(lvl)^(™<°°- 

n>l « 

Next note that 




and therefore 

sup£(|A:„|l [ |* n | >a] ) ->■ 0. 

n>l 

Thus {A',} is ui. So given e > 0, there exists S > 0 such that if P(A) < <5, 
then 

sup f \Xi\dP < e. 

I J A 

Therefore, given e > 0, if P(A) < S, 


f S n 
sup / — 

n J a Tl 


We conclude {S„/n} is ui. 

6.7.6. First of all we have 


sup E{ \Xn - x\) < sup E(\Xn\) + £(|.Y|) < OO, 

n n 

sipce {A' n } is ui. 

: Next, suppose we are given e > 0. There exists S > 0 such that if 
P(A) < S then 

fjx n \dP< £ ~, j A \x\dP< £ ~. 

So if P(A) < 6, 



X\dP< f \X n \ dP+ f \X\dP< £ -+ £ - 

Ja J a l l 


£. 


6.7.7. We show {JY„} is ui iff sup n <r„ < oo, where of course, — Var(.Y„). 
Suppose N ~ N( 0, 1); that is, N has a standard normal distribution. Then 

X n — cr n N. 
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If {X n } is ui, then 


oo > sup £'(|A' n |) = sup <r n E(\N\), 

n n 

which implies the condition sup„ <r n < oo is necessary for uniform integra- 
bility. If sup„ <r n < oo is assumed, then sup„ jS(|X„|) < oo and 

sup f \X n \dP = supcr n j \N\dP. 
n J A n J A 

Given e > 0, choose <5 > 0 so small that for P(A) < <$, 

j \N\dP < e/ sup <r n . 

J A n 

6.7.9. How to get equality in the Schwartz inequality: With 

t = E(XY)/E(Y 2 ) 

we must have equality on (6.14) on page 186 so 0 = E((X — ty) 2 ) yields 
l = P[X-ty = Q] = P[X=^^-.Y]. 

6.7.13. We have £7(|^Ti | 2 ) < oo and 

n -P[|^i| > = E ( n i[ iy >n ]) < ^■■^ , (l^i| 2l [|A’ 1 p>£2n]) -> 0, 


since |Xi| 2 £ L\. 
Then 


\7£*!> e 

lY > >e 


n 

- ^*{ U [l-X’fel > £\/”]} < n^[|Xi| > £\/n\ 


0. 


k = 1 


6.7.15. Write 

^(1*0 — X n |) <E((X o — ^n)l[AT 0 >X„]) + E((X„ — Xo)l[x„>X 0 ]) 
=A + B. 


For A: 
and 


(X 0 - X„)l[x 0 >x n ] < X 0 € L\ 


P[(X 0 - X„)l[jf 0 > A ' n ] > e] < P[\X 0 - X n \ > e] -> 0. 
Thus, by dominated convergence, 

A = E((X 0 - ^n)l[Xo>X„]) 0. 
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For B, use a variant of Pratt’s lemma (Problem 5.10.30): if 

0 < fn < Vn 

and 

P P 

£n ^ £oo j 1]n ^ ^?oo j 

and E(r) n ) -4 E(tj oo) < oo, then f?(f n ) -4 £’(^ 0 o) < oo as well. To see 
this, let {£ , (^„/)} be a convergent subsequence. There exists a further sub- 
sequence {n"} such that along this subsequence both 

f a.s. f a.s. 

Sn" -4 foo, Vn" -4 7?oo- 

By Pratt, .£(£„//) -4 £(£ 

OO ) and hence any convergent subsequence of 
{£'(&»)} converges to the correct limit; therefore the full sequence con- 
verges as well. 

Back to B: We have 


0 < (-*n ~ X 0 )l[x n >x o ] < X„ 
and E(X n ) — >• E(Xq) and 


P[{X n — ^ 0 )l[jf„>A-o] > f] -4 0. 

Thus 

e([X u - A'o)1[x„>a' 0 ] > e]) -4 0 

by the Pratt lemma variant. 

Thus we conclude E(\X n - X 0 |) -> 0 as required. 

6.7.16. (a) If a sequence converges to 0, then its Cesaro averages converge 
to 0. 

(b) If ||X„|| p -40, then by Minkowski (triangle) inequality 


E?=i 



m\p -+ o 


since convergence to 0 always implies Cesaro convergence to 0. 

(c) Let the probability space be [0, 1] with Lebesgue measure. Define 
Xi,Xi to be the indicators of (0, 1/2], (1/2, 1] so that Xi + X 2 = 2. Then 
define X 3 , X 4 , X$ to be the indicators of the three subintervals of (0, 1] of 
length 1/3 so that X 3 + X 4 + X 5 = 3. Let X%, . . . , Xg be the indicators of 
the 4 subintervals of length 1/4 so that X 6 + \-X 9 = 4 and so on. Then 

p 

X n -4 0 since the length of the intervals on which any indicator is different 
from 0 shrinks. However 


-pf 1 + X 2 )=l, 

I( Xl + ... + * 5 ) = l+i = l i 
i(X 1 + ... + * 9 )=2±|±i =1) 


9 



and so on. Therefore £ J''™ X,- does not converge in probability to 0. 
(d) We write 
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X 


n 


n 


Sn 

n 


t n - I n S n - 1 
V n ) n — 1 


4o-(i)-o = o. 


6.7.19. We have for any S > 0 

P[\X n \ >S\< P[Y n > S] 0, 


4 p 

since Y n -> 0. 

6.7.20. Suppose Y is a non-negative random variable satisfying 

£(y) = i, £;(y 2 ) = t>o. 

Further suppose 0 < a < 1 and define 


( x — a )( a + — x . 




( 6 /( 1 - a )) 2 


Then u(-) is a quadratic function with roots at a and a + 26/(1 — a) and 
with a positive maximum of 1 at the argument a + 6/(1 - a). Note further 
that 

utex/ 0, if;c < aora; > a + 26/(1 — a), 

“ \l, if* eR. 

On the one hand, 


E u(Y) =Eu(Y) l [y<[- , +2t/(1 _ a)]] +^mi [y6[aia+a6/(1 _ a)]] 

; <0 ■ P[Y <£[a,a+ 26/(1 - a)]] + 1 • P[Y 6 [a, a + 26/(1 - a)]] 

<P[V > a]. 

On the other hand, 


Eu(Y) = 


(1 

-a) 2 


6 2 

(1 

-a) 2 


6 2 

(1 

-a) 2 


6 2 

(1 

-a) 2 


6 2 

(1 

-a) 2 


b 2 


£((Y-«)(<. + — t_-y)) 
f , 26 26 
I — a l — a 

{(a+ ~ a ) ~ 6 + a} 

{a(l - a) + 26 - 6 + a} 

{2a — a 2 + 6}. 


) + a ) 
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For 0<a< 1,2a — a 2 > 0 and so the above is bounded below by 


- 6 2 


We conclude that 


P[Y > a] > 


(1 - a) 


Now for X satisfying E(X 2 ) = 1 and £7(1 A" |) > a > 0, set Y = 
\X\/E{\X\). Then 


r2\ E(X 2 ) 


^) = 1, *(^ = 3^-^=:*. 


For 0 < A < 1, 


P[m>Aa] = P [y>^] = P[y>a'] 

for a' = \a/E{\X\) <E (0, 1), since 0 < a/£7(|^|) < 1. Thus 


P[\X\ > A a] =P[Y > a'] > 

=( l -EmY- E2 " x " 

= (£(|A'|) - Aa) 2 = - A)" > a(l - A) 2 . 


6.7.23. A sequence of random variables {An} converges in probability to 
oo if for any M , we have 

P[X n > M] —>1, n —¥ oo. 


For any integer M, 

P[T(s) > M] = (1 - s ) sk = “> !. 

k>M 

as s — ► 1. So T(s) A oo. 

Note 

OO 

(1 - s)U(s) = £(1 - s)s n u n = E(u t{s) ). 

n=0 

p t p 

Now T(s) — > oo as s — > 1, implies ut(s) u. To see this, observe that 
given any S > 0, there exists n o such that 

|u„ — u| < S. 
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Therefore 

■f > [l' u T(») — u l > < P[T{ S ) £ no] 0, 

as s — > 1. The result now follows by applying dominated convergence to 
convergence in probability. 

6.7.24. (a) We have for any S > 0 

P[ \X n - *| 2 > s 2 ] <P[ \X n - X| 2 + \Y n - y| 2 > 6 2 ] 
=P[d((X n ,Y n ),(X,Y))>S}^0. 

(b) By part (a), it suffices to assume the range of / is ffi. 

Given any subsequence {n(A:)}, there exists a further subsequence {n(fc')} C 
{n(fc)} such that 

X n (k') X, -4 Y 

almost surely and by continuity of /, 

f(X nl k'),Y n{k .)) ^ f(X,Y) 

almost surely. By the subsequence characterization of convergence in prob- 
ability we have 

f(X n ,Y n )$f(X,Y). 

(c) Define the continuous function / : M 2 i-> M 2 by 

f{x,y) = (x + y,xy). 


Apply (b). 

6.7.25. (d) Suppose it is possible to metrize almost sure convergence with 
the metric d(-, •). Let {X n , n > 1} be a sequence of random variables such 

p 

that X n — » X but that {A”„} does not converge almost surely. For instance, 
Example 6.2.1 provides such a sequence. Since almost sure convergence 
fails, there exist a subsequence {n*} and a S > 0 such that 

d{X nk ,X) >6. 


Since X n X , given the subsequence {n*}, there exists a further subse- 
quence {n*(j)} C {njc} such that almost sure convergence holds along the 
subsubsequence: X nk{j) ^4' X and therefore 

d(X nkU) , X) ->■ 0. 

However, this contradicts the previous display so metrizing almost sure 
convergence is impossible. 

6.7.26. (a) If 

= h^r 1(o ' i/n) ’ 
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then 


Also we have 


E(X n ) = JO- . I = J- o. 

log n n log n 

r*l jn 


f L,n n 

EX n (s)l^ u:Xn ( u )>a}(s) = j^^l{ u . n /]ogn>a and u<l/n}{s)ds 

_ / logn ’ ^ logn ^ °> 

\®> ^ < a ' 

Therefore if we set U{x) = x/ log x we have 

sup/ \X n \dP = \/ -i-< \/ J-_0 

" n/lognx, 10 ^ n>cA-( a) l0 S n 


as a — ¥ oo. 

Finally, to see that there is no dominating variable, we suppose there is 
one and get a contradiction. Suppose 


Xn < Y G M0,1). 

This means on (0, 1 /n), we have Y > n/logn. Thus 

OO 

B(r)=^£(5' W l IA4]W ) 


n = l 


>E 


n ( 1 1 


— log n \ n n + 1 

00 l 

: - = oo 

^(n+l)logn 

by comparison with the integral /“ y~ l dy. 

(b) Suppose 

Xn = nl(0,l/n) - nl[l/n,2/n)- 

Then 

E(X n )=n---n-- = 0 
n n 

and for any c > 0 


P[\X n \ > e] < P( 0, 2/n) = 2/n -> 0. 


!*»(«)! 


n, if 0 < s < ^ 
0, if £ < s < 1. 


Note that 
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Therefore 


-E^|^fr»|l[|X„|>a] — J n l{u:rj>a,u<2/n}( s )^ s ^ — 


•| = 2, if n > a, 
if n < a, 


and thus, finally, 

SUp£'(|X„|l[| X „ | >a]) =2, 

n 

so the sequence {X„} is not ui. 

6.7.31. (a) Since X„ -c„ 4o, we have P[\X n — c„| < e] — > 1. Thus for all 
large n, 

P[X n G [c„ - e, c„ + e]] > 1/2. 

From Exercise 5.5.31, we get that 


m{X n ) € [c„ - e,c„ + e] 

for all large n. Since e is arbitrary, we have m(X n ) - c„ -> 0 as n oo. 

(b) Because X has a unique median m, for any € > 0, there is a <5 > 0 
such that 


P[X < m - e] < 



P[X > m + e] < ^ — <5. 


Therefore, 


P[X n < m - e] —P[X n < m - e, |X - X n \ < e/2] 

+ P[X n <m-e,\X-X n \>c/2] 

<P[X <m- e/2] + P[\X - X n \ < e/2] 

: <\-S + o( 1 ). 

Therefore, for all large n, we have m(X n ) > m — e/2. In a similar way, we 
show m(X„) < m + e/2. 

6.7.33. Assuming that A m - > 0, we have 

> e] =P[S n > ne] < P{{ J[X nj > e]} 
j = 1 

n 

=F[\/ > e] -> 0 

i=i 


as n — > oo. 
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Chapter 7 Solutions 


7.7.6. We have E(Xk) = -y k so that J2k 7* < 00 implies YlkE(Xk) < 00 
and therefore X k < 00 a.s. 

Conversely, if Xk < 00 almost surely, then 


OO OO OO / 1 \ 

0 < 4-E.**) = s(n =■•'*) = n^*-**) = n u) 

1 1 k = 1 ' ' 


7 * 


and 11 (s) 7 ‘ > 0 iff E k 7fc(log2) < 00 iff J2k Ik < 00 . 
k 

7.7.7. (a) If luj =1 £: fc (w) = 1, then to £ U£ =1 .Efc and the left side equals the 
right side since both are 1. If lu » = 1 E *( w ) = 0, then both sides are zero. 
Using (a) and the Schwartz inequality, we have 




= -X>0 j < ^(^^(EieJ 2 

=£(1u; =i eJ£(E U) a = ^(Q E (Z u) a 


k = 1 
\2 


* = 1 


fc=l 


Therefore 


p[{jEk 

\k = 1 


(^Ei Sk ) 

*(?**)’ 


(b) Suppose 

(i) £«1 = OO , 


(ii) P(E m E n ) < cP(E m )PE(n — m). 
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Then 


oo oo 

P(limsup£’„.) = lim P\ II Ej) = lim lim p( I I eA 

«-+ oo n ~+°° V W / n^ooN-Kx> \ ^ 3 / 

3 =n + 1 

(sEjU.i*,)’ 


j=n + 1 


> lim lim 

n-foo N—too 


— lim lim 


1*,) 

(SjU. P(E,)) ; 


EjU+i P(Bi) + 2E> + . a <.<wP(®i«*) 

/TV \ 2 

(E^)) 

V»X1 ' 


> lim lim 

n — foo N—ioo 


> lim lim 

ri-t-oo N-too 


= lim lim 


Ej=n+i P(Ej) + 2e^) rJ+1 ^ J . <fc ^ Ar P(Ej)P(Ek-j) 

(gjU. 

e;I, + i f<E) + 2 «(eJL. + i 


= 7T- >0. 


( E P(^)) _1 +2c 

j'=n + l 


(c) Suppose Y n > 0 are iid with common distribution G and X n > 0 are 
iid with common distribution F. We have from Fubini’s theorem 

f^hr*- > f] =£ [f G{dy)F n (dx) 

n^l \/X ; n JJ {(*.»):*>«} 


\/X 

i= 1 


So if 


then 


=£ / f / , pn ( d *) 

n v y€[0,oo) [_-/{jT:y£ -1 >r} 

/♦OO 

=E/ '*(D»w 

_ f G(dy) 

J l-F(y/eY 

f°° _<?{dy) 

Jo 1- 


G(dv) 


-F(y/<0 


< OO, V£ > 0, 


oo v 

!>[-£->«]< 

n = l \/ *i 

t = l 
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and 


which implies that 


p [~ir~~ > e i-°- ] = 0, 

\JXi 


Y n 

yxi 

1=1 


-*0 


almost surely. 

For the converse, we suppose Y n / V" =1 Xi ^1' 0. Set E n 
so that P(E„ i.o. ) = 0. For m < n 


v 


Xi - > £ ] 


P(E m E n ) =P 


<P 


Ym Y n 

V m y ^ £ > n £ 

*= 1 Ai V Xi 

i=i 

Ym Y n 

m ^ £ > n > £ 

V V Xi 

Lj = 1 


=P(E m )P(E n _ m ). 

We conclude that X^^Li P(E n ) < oo, and it follows that 


f G(dy ) 


< oo. 


7.7.8. From problem 6.7.5, we have {S n /n,n > 1} is ui and hence the 
SLLN plus Theorem 6.6.1 proves L\ -convergence. 

-7.7.9. Define Xj = Aj l[|Xj|<j]- Then 

J2 p [ CJ ^- * < J2 p i\xA > j] = E^ii > j! < ~ 

i J i j 

since i?|Xi| < oo. Therefore ^y 2 - converges almost surely iff ^ ffiL. 
converges almost surely and for this, it suffices to check 

T, Var ( ej r) < E v,i<ii) < <»• 

To see that the right side expression indeed converges, note that it is 
bounded by 

V l c *| 2 H 72^(*7 ?1 [l*il<i]) < °°- 

k j J 
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Note, V fc \ck? < oo since {cj} is bounded and the sum of the expectations 
is finite by the argument used to prove the strong law of large numbers. 
We therefore conclude that 


£ 


c j Xj 
3 


converges almost surely 


and by the Kronecker lemma, we get 


r — . CjXj 

> -1—2- -> 0 a.s. 

“ n 

j=i 


as n — >■ oo. 

7.7.10. (a) Start by supposing that {£_,■} are independent and E (£_,• ) = 0, 

and |^j| < M . Then ^ X^£j 0- To see this, it suffices, by the Kronecker 
j = i 

lemma, to show that X^- converges almost surely. For this, it is enough 
to check the Kolmogorov convergence criterion that X^Var^j/j) < oo. 

3 

However, we have 

1 i j[/f 2 

^Varfe/j) = X)^2 Var fe) < E (%) - 5Z ~iT < °°' 


; 3 


T 3 


Now let ^ = Xi +J ( m+ i) where {X„} is m-dependent. From the above 

n ... 

discussion, we have / n -4* 0 as n -> oo. However, 


j=i 


- n 1 m+1 

«=1 * = 1 j:i+j{m+l)<n 




to+ 1 r n ~ i 1 

_ y* l~J 

n 


i=l 


1 E ' 

J=Q 

r »-» l 
Lm+1 J 


(b) We have 


TO + 1 

->E 1>0 = 0 - 

i=i 


1 n 

N n (u lt . ..,u k ) = 

— U 1 >■ • • ,-^m+fc — 1 — Vfc ] * 


m=l 
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The indicators are ^-dependent and 


k 

^[X m =ui,...,X„ 1+t _i=U| c ] — JJPu; 

« = 1 


is bounded so from (a) 


N n (u 1 , • • -,u k ) 

n 


- a -* o. 


i=i 


7 . 7 . 12 . Let {U n ,n > 0} be iid f/(0,l) random variables. Then Xq — Uo 
and X n+ i = U n+ iX n so that X n+ \ = nT^o 1 Therefore, by the strong 
law of large numbers 

iio g x„ = if;iog(/,‘4-i, 

»=0 

since, for x > 0, P[-\ogU\ > x] = P[U\ < e~ x ] = e~ x and -logt/i has a 
unit exponential distribution. 

7 . 7 . 13 . Use Problem 7.7.15. Then Yl n -^n < 00 almost surely iff for any 
c > 0, 

(!) E„ p [|Af«| > C 1 = En e_AnC < °°- 

( 2 ) En £(*nl[|X„|<c]) = En [*n *(1 ~ e~ A " c ) - Ce“ A " c ] < OO. 

Now (1) implies A„ — ¥ oo and thus (1) and (2) hold iff 
(20 ^A-Ml-e-^Xoo 

n 

and (1) hold. However the series in (2’) is the same as Yl n A “ r — E n A~ 1 e~ A " c 
and thus, we have that (1) and (2) hold iff (1) holds. 

7 . 7 . 14 . If J2 n a n < 00 ) then by the Kolmogorov criterion, E n (^n — Pn) 
converges almost surely and since ^2 n fi n converges, we get J2 n X n con- 
verges almost surely. 

Conversely, suppose E n ^n converges almost surely. Let {Xj } be iid 
copies of {X„} and then Ej=i(^j — Aft) converges almost surely. Note 

V«(D*i-A3))=2i!>J=:.; 

j=l j= 1 

and N n := J2] =1 (Xj - Xj) is a normal random variable with mean 0 and 
variance . So we assume 

N„ => Xoo 
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since {N n } is almost surely convergent, where Xoo is some proper random 
variable. For the purposes of getting a contradiction, suppose s n -»■ oo. Let 
N(0, 1) be a standard normal rv with mean 0 and variance 1 and then for 
any r£lasn->oo 

P[N n < x ] =P[s n ./V(0, 1) < *] = />[IV(0, 1) < — ] 

s n 

—>P[N(0, 1) < 0] = l - = P^ < x ] 
which means X cannot be proper. 

Therefore, &] < oo and * s convergent by the Kolmogorov 

criterion. Since Xj is convergent, we get fij is convergent. 

7.7.15. We suppose that V n > 0 and that 

> c] < OO, J3-E , (l / nl[V',< C ]) < OO. 
n n 

Then it follows that 

X^Var(K„l[y n < c ]) < '^2 / E{Vn\[v n <c]) < cy^E(V n l\ Vn<c {) < oo. 
n n n 


7.7.16. Since |S„/n| ~ |a*| ^ 0 by the strong law of large numbers, it 
suffices to show 

-M n :=-\J |*,.| 4 0, 

n n . v 

i=i 

as n -*» oo. Since i?(|Xi|) < oo, we have 

lim -|X„(w)| = 0, 

n—foo n 

for w G A and P( A) = 1. Now for each n, there exists k(n) < n (which is 
random) such that M n = Xf.( n ) and therefore, 


-M n < 
n ~ k(n) 


Suppose w G A. There are two cases. In case 1, k{n,u > ) -> oo, so that 

0. 


-m„h < 

n ~ k(n,u) 


In case 2, for some integer M(u>) < oo, we have k(n, w) < M so that 


M(w ) 


-M n (u) < - V l*.'( w )l °- 

n n v 

i=i 
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The desired result follows for either case. 

7.7.17. We have 

so P[Xk = k 2 i.o. ] = 0 and for k > ko(u), we have for almost all w that 
Xk(u ) — —1. Therefore, 22k X^ — — oo. 

7.7.18. We have that 22 ji*i OR j converges almost surely by the Kolmogorov 

j 

convergence criterion, since 

^ v "fe) = ?J(sbF <00 ' 

By Kronecker’s lemma 

22 Xj 

-Jzl a 4- o. 

n 1 / 2 logn 

7.7.21. We need the fact that Xi (9) has density 

fe(x) = l( x /e) n e-^/ „!, x > 0, 

so that 

1 "+ 1 

JV„ +1 (^) = — — — x i( d ) has density (n+ 1 )fe({n+ 1)*) , x > 0. 

^ l * . - 

1 = 1 

By the weak law of large numbers 


X n { 6)$0 


and by continuity we also get 


u{X n {9)) 4u(0), 


and since u is bounded, dominated convergence yields 


E e (u(X n (6))) 



nfe(nx)u(x)dx — ► u{6). 


We now check uniform convergence on a compact interval I = [a, 6], 
Let 7 + = [a/2,26]. Define the modulus of continuity of u for any compact 
interval J by 

u s (J) := sup |u(x) — u(t/)| 

|r-s/|<<5 

x,y£J 
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and since u is uniformly continuous on J, we have u>s(J) — >■ 0 as 8 4- 0. Now 
decompose as follows: 


sup|£' e (u(X„(^))) - u( 0 ) | < sup E /0 |u(Y„(0))) - u(0)| 
eel eei 

<su P E e |«(X n (fl))) - u(0)| l[|x„(9)-9|<,5] 

+ SU P £« |«(*„(*))) - U(0) | l[|X n (9)-9|>i] 


which for <5 small has an upper bound 


<w«(/+) + 2||u|| supP,[|.Y B (0) - 6 \>S\ 
eei 

=1 + II. 

Here, ||u|| = sup l€K |u(a:)| < oo. Now for II we have 

11 <2||u||^sup Var(X„(0)) = 2||u||-^sup -Var^^tf)) 
o eei <> eei n 

=2||u||^r-- sup^ 2 ->■ 0 

n eel 

as n — ^ oo. Therefore 


limsupsup \Eg[u(X n {0))) -u(0)| <w,s(/ + ), 

n~¥ oo 9£l 

for any 8 > 0 and letting 8 4- 0, yields the result. 

7.7.22. (a) You can differentiate under the integral sign; this is justified 
by dominated convergence. For instance, 


-( 


F(X + 8 )-F(X) 


e - 6 x )e~ Xx F{dx) 


= Io (/> e ~ 6ydy ) e ~ XXF ^ dx ^ 


Set 


G x {dx) = e- Xx F{dx)/F{X), H s (x) 



Then 


H s {x) < x e Li[G x ) 


and as J — > 0 


Hs(x) ->■ x. 
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Therefore, by dominated convergence, as 8 — >• 0 

/*0O /*00 

-> / xGx(dx) ■ F(X) = / a:e -Ax .F(da:). 

Jo Jo 

(b) Fix 6. Then by the weak law of large numbers 

i=l 

since the limit is the mean. The rest follows from the fact that Y2?=i &(0) 
has a Poisson distribution with parameter n6. 

(c) Write 


j<nx J Jo j<nx 

f°° 1 

= / P[—PO(ns) < x]F(ds), 

Jo n 

where PO(ns) is a Poisson random variable with parameter ns. Note for 
any x > 0, 

P[-PO(ns) < x] -4 j 1, lfx>s ’ 
n > — \ ifx<s 

If F is continuous at x, then for any S > 0 

j<nx 

t- rx — S ^ rX+6 i 

= / P[-PO{ns) < x]F(ds) + / P[-PO{ns) < x]F(ds) 

Jo n J x _ s n 

+ / . P[—PO(ns) < x]F(ds). 

J z+<5 ^ 

By dominated convergence 
f x ~ s 1 

I P\— PO(ns) < x]F(ds) -4 F(x — J), 

Jo n 
f°° 1 

I P[—PO(ns) < x]F(ds) —>■ 0. 

J x+S ^ 


Therefore, 


j“ f £ > F{x -8)^ F(x) 

A* * ‘ 


j <ni 
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as S — » 0 and 

limsup y2 ^ 7 i j F ( - j '>(n) < F(x + S) + F(x - S,x + £] -> F(x), 

n-yoo rT" 1 J- 
]<nx 

as S — ^ 0. This shows the result. 

7.7.23. We have 

*(*■’> = = l = 

The rest follows from the weak law of large numbers since 

2-" A n (B niS n /„) = P[y/l ?3 - S < Hi < 7173 + S] -» 1. 


7.7.43. We have that the series defining Y converges from the fact that 
A'/2', n > 1} is non-decreasing in n and therefore has a limit. The 
limit must be finite since 


00 D OO 1 

2 ’ - 2 * 
i=l » = 1 

The range of Y is 0 (when all Bi’s are 0) to 1 (when all B,’s are 1). 
We have 


and 


w n 00 - 

«=1 :=1 


Let x G [0, 1] be represented by its non-terminating dyadic expansion 

00 

E x,- 

¥’ 

1=1 z 

where x* £ {0, 1}. Then <Q p concentrates on the following subset of [0, 1]: 
A p := {x€[0,l]: n lim i^x <= p}. 


i = l 


Consequently, if p ^ p', then 

Q P (A P ) = 1, Qp(A p i) = 0. 
(b) Denote a dyadic interval of length l/2 n+1 by 


I(bi := [. 61 . .. 6 „ 0 , . 61 . .. 6 „ 1 ). 
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Then 


P\Y E I(bi, . . .,6„)] =P[Bi = bi, i = 1, ... . , n, £ n+] = 0] 

— p£ i=i ^‘q n ~ 5^"=i b'q. 

So for i£[ 0 ,lj,i£ I(x i , . . . , x n ) and therefore 

Q P ({«}) < p [Y £ I{x\, ■ ..,x n )= pE?=i x i q n -'£?=i x < q 0 , 

as n — >■ oo and therefore Q P {{x}) = 0 and F p (-) is continuous. 

To see that F p is strictly continuous, note that if x\ < x 2 , then for big 
enough n, there is a dyadic interval I on the l/ 2 n grid which is contained 
in (21,3:2] and therefore 


Qp(x 1,22] > Q P {I) > 0. 


If 2 < 1 / 2 , 




Bi 


1=1 ' 


2 * 


1 = 1 


2 s 


i=2 i=l 

00 R 

=^Eof^ 2 *]- 


1 ^ Bi. 


i = 1 


since {Bj,j > 2 } = { 5 j,n > 1 }. 
. If 5 < 2 < 1, then 


»'=1 i=l f=l Z 


Bi 


and since B\ — 0 implies Y < 1/2 we get 


r 1 A Bi 

=9 + pP[^ + 22^<x] 

1=2 

nr l 1 ^ Bi 
=«+pP[j + 5 £jr<x] 

1 = 1 

00 R. 1 

=1+PPlT, 2T< 2 (*-2)]- 
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7.7.45. By the strong law of large numbers, we have 

— ^ogp n (Xi,...,X n ) — 1 

=—2^PX‘ 

i=l 


^E(~\ogp Xl ) = -^Pilogpi = H . 


f=i 


7.7.46. For the Cauchy distribution, £7(|^i |) = co so the conclusion for 
the sums follows by the strong law of large numbers. 

Note as x — >• oo 


p&i > *] = / 

J x 7T(1 + U 


du 

- 4 ) nx 


so for x > 0 


nP[X i > nx/w ] ~ n ► x~ 

nnx 


Therefore, for x > 0 

P[\/ X { < nx J 7 r] =(P[Xi < nx/n]) n = (l - nP ^ Xl > nx/v] y 
1 = 1 

— >-exp{— a; -1 }. 


n 
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Chapter 8 Solutions 

8.8.2. (a) We have -4 0 since P[|X„| > e] = -4 0. 

(b) We have X„ => 0 since for a constant limit, convergence in probability 
is equivalent to convergence in distribution. 

(c) We have 

£>[*„ = «] = £1 = 00 
n n 

and therefore 

P{[X n = n] i.o. } = 1 

and lim sup^^^ ^*- = 1. We conclude limsup„_^ 00 X„ = oo almost surely. 

Also lim infn^oo X n = 0 since X n A 0 implies that for some subsequence 
{«*}, we have X„ k ^1' 0. Thus lim infn^oo X n < 0. Since also P[X n > 0] = 
1 we have lim infn^oo X n = 0. 

8.8.3. Note — log U = E where P[E > x] = e~ x , x > 0. By the strong law 
of large numbers, 


» -Eiogf/,- 

-logll^)—— 

, n n 

3 = 1 


1 a.s. 


By the central limit theorem 

* - log Uj — n 


Z- 

3 = 1 


y/n 


N( 0,1) 


so 


Vn [ £ - log Uf - 1 


\3= i 


Let g(x) — e x . By the delta method, 


( AT (0, 1). 


~e ^£(-log£J,-) 


=»<; , (l)Af(0,l) = -e- 1 7V(0,l). 


8.8.4. (a) Suppose X n has distribution F„ for n > 0. Suppose X n => Xq. 
Given k and e < §, we have (fc — e, k -f e) is an interval of continuity of 
Fo(x) and so 

P[X n = k] = P[X n e {k - e , k + e]] -4 P[X 0 €(k-e,k + e]] = P[X 0 = k]. 
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Conversely, suppose a < b are not integers. Given that P[X n — k] — » 
P[X o = k], we have 

P[X n €(a,t]]= P[Xn=k]-> mo = ^] = m'o6(a,i]], 

k£( a >&] ^€(a,6] 

so P[X n £ /] — > P[X o 6 /] for intervals of continuity. 

(b) Let fi be counting measure on the integers so that 

fi(A) = # integers k £ A = E >-(*)• 

k 


Set p n {x) = Ylk P \ x n = (a:). Define 

F n {A) = P[X n £ A] - £P[X„ = k] = f Pn (x)fi(dx). 

k£A Ja 

From (a), F„ => F 0 iff P[X n = A] -> P[X 0 = A;] iff p n (x) -> po(x), for 
all integral x. But according to Scheffe’s lemma, p n (x) — »■ Po(x) implies 
Pn — »• Po in Li(dp ), that is 

= k]~ P[X o = At] | = f | p n {x) - p 0 (a:)|//(da:) ->■ 0. 

k •* 

(c) From (a): \ An -»■ l Ao iff 

P[l An = 1] = P{A n ) P[l Ao = 1] = P(A 0 ). 


(d) Suppose x n — » xq. Let / be bounded and continuous. Then 

; J fdFn = /(*„) -> f(x 0 ) = j fdFo 


and hence F n => Fo by the Portmanteau theorem. 

Conversely, if x n -/> Xo, then there exists e > 0, and there exists a 
subsequence {n'} such that \x n < — Xo| > e. Define f(x) = |xo — x| A 1 which 
is bounded and continuous. Then 


J fdF n i = |x 0 - x n /| A 1 > £ and J fdF 0 - |x 0 - x 0 | = 0 


so f fdF n -fr f fdF 0 and F n F 0 . 

(e) For / bounded and continuous 


Ef(Xn) =i/(i - V i/(i + ±) -+ 

l n l n l l 

=/(l) = Ef(x) 
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and therefore X n => X . Define the mass functions 


fn{x) 


0, if x <£ {1+ ^,1 - £} 

' b ifa: = l ~ b 

if ^ = 1 + ^ 


fo( x ) = 


1 , 

0 , 


if x — 1, 
if x ^ 1. 


Then for every x, f n (x) -f* fo(x). 

8.8.5. (a) On [a, 6], uq is uniformly continuous so given e > 0, there exists 
S > 0 such that for ti,t 2 € [a, 6] we have 


|<i -t 2 \ <6 implies |u 0 (<i) - w 0 (< 2 )| < £• (*) 

Let Ns(t) = {s : |t — s| < J} be a J-neighborhood of t. Then 


M]C 1J N s (t) 

t€[a,b] 

and by compactness of [a, 6], there is a finite subcover 

k 

[a, 6] C jJiVtf(ti). 

i= 1 

Without loss of generality we can suppose 


to — a < <i < <2 < < tk = b 

and 

W, ,• 6 

i = l 

since if necessary, we can increase the subcover to achieve this. Pick no so 
large that for n > no 

sup |u„(t,) - u 0 (U)\ < e. (#) 

0 < j < n 

For x E since u n is nondecreasing, we get for n > n 0 that 

|u„(z) - Uo(z)| <| U n {x) - U n (tf ) | + \u n (U) - Uo(tj) | + |u 0 (<i) - U 0 (X)| 
=A + B + C. 

For A we have 

A <u n (ti) — u n {ti- 1 ) (by monotonicity) 

<uo(U) + e - (u 0 (<i_i) - e) (from#) 

=2e + uo(ti) — uo(< t _i) < 3e (from *). 
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We also get B < e (from #) and C < e (from *). We conclude that 

k 

sup |u n (x) - m 0 (®)| < V sup |u„(x) - u 0 (*)| < 5e, 

*e[a,fc] i=1 «e[«.-ti-i] 

provided n > no- 

(b) Given e > 0, pick M > 0 such that 

F 0 (-M)\/(l-F 0 (M))<e. (##) 

Then pick n o such that for n> no 

\F n {±M) — F 0 {±M)\ < e and sup | F„(x) - F 0 (x)\ < s. (**) 

[~M,M] 

Then we have 

sup|F„(x) - F 0 (:c)| < sup \f sup \J sup 

r£K x<M -M<x<M x>M 

<{F„(M) \J Fo(M)) \J sup |F n (x)-F 0 (z)| 

x£[-M,M] 

V[(l — F n {M))\J {\ — Fo(M))] 
<{(Fo{M)+e)\J Fo{M))\Je 

\J{\-Fo{M)+e)\J{l-Fo{M)) 

<2 e\J e\J 2e — 2e. 

(c) We now verify the Glivenko-Cantelli lemma for this special case: Let 
F n [x f ui) = 53"_i l[x,-<a:]( w )- There exists N x G B, such that PN X — 0 and 
if u) G N£ then F n (x,u>) — ¥ F(x). Let Q denote the rational numbers and 
we have that 


lj G P| implies F n (x,w) ^F(x). 

zg<Q) 

Now A := f| N‘ G B, and P(A) = 1 and for w G A, F n (-,w) 4 F(-). 

zgQ 

Hence by (b), for all u G A: 

sup|F„(z,w) - F(z)| ->■ 0. 

rg® 

8.8.6. (i) If F(ax + b) = F(cx + d) then 

F < ~(y) — b F*~(y) — d 


a 


c 
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Proceed as in convergence to types theorem. 

(ii) It is enough to show F{Ax -f B) = F(x) implies A = 1,5 = 0. If 
A = 1, then 

F(y) = F(y + B) = F(y + B + B) = F(y + 2 B) = • • • = F(y + nB) 

and letting n -» oo gives F(y) = 1, (if B > 0) or = 0 (if B < 0) for all y 
which contradicts the fact that F is non-degenerate. If A ^ 1, then 

*•<# + i rj) =FM(V + 1^4 + S) = f'Ms + + 

Define G(y) = F(y+ yrj) and G(y) = G(Ay). So iterating, we get G(y) = 
G(A n y). If A > l,y > 0 we get G(y) = G( oo) = 1 and if y < 0 ,G(y) = 
G(— oo) = 0 so G is degenerate at 0. If A < 1 then G(y) = G( 0), forall y 
which also contradicts G being proper and non-degenerate. 

8.8.8. We have 

P[X{, n < a;] =P[at least l observations < a;] 

*=£+1 ' ' 


and thus the density is 

/A-,,„(x) = F < - 1 (x)/(a : )(l- J P(a ; )r- < 

Since F(x) = 1 — e~ x for x > 0, we get 


n\ 


(£- l)!(ix - €)! ' 


.1 


— f y ( — — (l — g n (e ^ 

n ‘"V n ) \ ) (£_i)!( n _£)i 

n \ n ) U + (£-l)!( n -£)! 

x e ~ 1 e~ I n(n — 1) . . . (n — £ -f- 1) 

rxt 


(£-1)! 


rr 


(£- 1 )!' 

8.8.10. We have for any 6 > 0 that 


P[\X n - X\ > <1] > P[Y = 0,X = 1] = i. 
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This does not converge to 0. Note X n => X since X n = X. 

8.8.13. If fj, n — >■ fio, and <r„ — > cr 0 then the densities converge 
n{n n ,cr n ,x) n{ii 0 ,cr Q ,x) 
as n — ¥ oo and Scheffe lemma applies. 

8.8.23. (i) We use the delta method with g(x) = x 2 to get 

Vn(g(X n ) - g(/i)) - gfa)) 

Xn 9\ft) 

=>g'(fi)N(0,a 2 ) = 2fiaN. 

(ii) Use g(x) = e x so the limit is g'(fi)N( 0, <r 2 ) = e^crN( 0, 1). 

8.8.34. Observe that if P[E\ > a:] = e ~ x , for x > 0, then with g(x) = a: 1 /" 
we have 

P[g(E i) > x] = P[£d > 5^(2:)] = e _r “, x > 0, 
so that {W„,n > 1} = {<7(£„),n > 1 and because g(-) is non-decreasing 

n n n 

\J Wi^\J g{Ei)=g{\J Ei). 

1 = 1 1 = 1 1 = 1 

Write 

n 

Y n ■■= \/ £>' - l°g" =* Y. 

i=l 

By the Baby Skorohod theorem, there exists Y# and Y# such that Y* = 
Y n and Y# = Y and Y& ^4 Y&. So we have 

vr=i W i - ffQogrc) ± 9 O'* + logn) -ff(logn) 

^'(log n) ff'(logn) 

:• ilogn 9{s)ds 

p'(logn) 

which by the mean value theorem is 

= 9'(C t) y# 
g'{ logn) ” ’ 

where is between logn and Y# + logn. Since Y& ^4 Y # , we have 
Cf / log n ^4 1 from which follows 

9'«*) = t a 

(/'(logn) Vlogn/ 

V"=l -g(logn) £ g'( (#) # . y# 1 y 

t?'(logn) 0'(logn) " 


Thus 
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Chapter 9 Solutions 


9.9.2. (a) We have 

E(e itXn ) = e *»( e “- 1 ) 

and therefore X n => Xo iff A„ — >■ Ao- 
(b) If //„ — ► no, and <r„ — > cq then 

<j>xAt) = e’^e - * 7 "* 2 / 2 -> c «' t /'o-«r 3 t a /2 


SO 


~ ^(//„,(T 2 ) => X 0 ~ Ni^Xl). 

Conversely: Suppose X„ => Ao- Let {A^,} be iid and independent of 

{ X„ } and have the same marginal distribution: X' n == X n . Then X n —X' n => 
A 0 - X' 0 . So 

<f>x n -x^(t) = e- 2a «‘ 3 / 2 -► e- 2<T o‘ 2 /2 = 0 jro _ jri (t), 

and therefore cr„ — »■ (To. But if cr n — >■ uo, then from convergence of the chf’s 
we get fi n -* fj, 0 - 


9.9.3. We have 


and therefore, 


bfext, let 


£x ‘ = 1 -F + l ' ! 'F = 2 -p- 2 ' 




xi = 


1 , if Xk = 1 or k 


— 1, if Xk = — 1 or —k. 
Thus {A'£} are Bernoulli random variables with 

p[x; = i] = \ = p[x; = -i] 

and S*/y/n => N(0, 1). Let 


m 0 = sup{m : < ey/n} = sup{m : ^(1 + m) < ey/n} 


k = 1 


> sup{m : (m + l) 2 < 2ey/n) = yj^ey/n - 1}. 
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If \s* n -s n \ > €\/n, then it means that there exists i > mo such that 
Xi ^ X £ , since if i < mo we would not get a big enough contribution to 
the difference. Thus 

IJ [*****]) 

mo<Kn 

n i n 1 

<Ip< £ F 

fc-m° fc = -^/2e-y/n — 1 

~(\/2«J 7 ) -1 — n -1 — ► 0. 

Sn S* P 


It follows that 


y/n y/n 

and by Slutsky’s lemma => N(0, 1). 

9.9.4. (a) We have 


0 


EUi = f, E\Uk^ — af/4 


and the Liapunov condition becomes 

n 

" PI TT |3 E a fc 

^MM_ =const * = 1 


fc = l 


(E2=ia2) 

M const 


< Mconst- 


E n 

fc=i a 


(E2=i«2) ! 


(ELi«i) 5 


o. 


(b) -We have = |E a I T s oo < oo so 


^ TE W t 2l [IM>«»l 7^> 0. 

*n j *» *oo j 

9.9.5. We know that 

-» 0x„(*) an d 0y„(O -* ^y 0 (f) 

so if is independent of Y n we have 

<Px n +Y n {t) = <t>X n {t)<l>Y n {t) ->■ 4>Xo(t)<f>Yo{t) =4>X 0 +Y 0 {t )■ 

9.9.6. (a) We have 

2cosfn 


<M0 = r e itx -dx = 
J-n n 


itn 


-> 0 . 
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(b) This follows from the cosine funtion being bounded by 1. 

(c) No. This does not contradict the continuity then since the limit does 
not satisfy 0(0) = 1. 

9.9.7. If 

f{x) = x ~ 3 , |z| > 1, 

then E{X n ) = 0, and E(X 2 ) = oo. Set 


Then 


Y n X n l[|x n |<^/n log n] • 


y/n logn 

31 1 x 3 x~ 3 dx 


E ( Y n) — E 'l^’n| 3 l[|A'„|<yH'logn] = 

= \/nlog7i — 1 ~ y/n\ogn. 


Also, we have 


E ( Y n) E ( X n ^[| A” n | < v /n log re]) = 2^ 

=2 log(v/n log n) ~ log n. 


y/n log n 


x 2 x 3 


dx 


Therefore, 


and 


71 pTl 

T, e < y I ~ / 

l 


log xdx ~ n log n 


n 


E^l^nl 3 


S 


3 

n 


/" y/xlog xdx ji § log 71 

(nlogn) 3 / 2 7i t (log rc) t 


1 

(logn) ? 


-* 0 . 


So we see that the Liapunov condition holds for {V n } and consequently 

J2 Y j/s n => N and by the convergence to types theorem 
j=i 


n 

EW-logn => N. 

3 = 1 


Lastly observe that 

± Y n ] = £>[|X n | > \/n log 7l] = £2 r x~ 3 dx 

n n n ■'■y/nlogn 

■^n(logn ) 2 < °°’ 



The demonstration can now be completed with the Equivalence Proposition 
7.1.1 since we have 

j a 4- o. 

Sn $n 

9.9.8. (a) Observe that if {X n } is iid with Poisson distribution with para- 

n 

meter 1, then S n = is Poisson distributed with parameter n. There- 

l 

fore, we have that 


E 




p -n JL. n k p~ n /«4/n fc + 1 n k \' 

= >S (n “ k) u = > fe(-*r " (^ryi) , 


and because this last sum telescopes, we get 


e~ n n n+1 e~ n n n+ h 


y/nn\ n\ 

(b) From the central limit theorem, 

S n ~ n 

y/n 


N, 


where N is a standard normal random variable, since E(X n ) = 1, and 
Var(X„) = 1. From the continuous mapping theorm 


Sn ft 

y/ft 


N~. 


(c) : 'We have 


and therefore, 


y/n / y/n 


that 


sup E 


S n ft 

y/ft 


Sn ft 

y/ft 


< 


Sn ft 

y/ft 


< sup E 


Sn-ftY _ 

V n ) 


So from the Crystal Ball Condition (6.13) we get that 
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Therefore the mean of the displayed random variable converges to E(N~). 
(d) We compute 


E{N~) =E(N + ) = 



e -* 2 /2 
x — ■ 7 =z-dx 


and making the change of variable y = x 2 /2 so that dy = xdx we get 


We conclude 


or 


9.9.9. (a) We have 


f°° e-ydy _ 1 

Jo \/2n \/2w 


n n +\ e " 


n! 


-> V2n 


I ^ e _n n" +1/2 . 





dx 


1 


1 — it 


Also, note that ) which is the characteristic function of —A. 

(b) The chf of Ai is «“+«“''* = cos t. 

(c) Observe that (cost)”" is the chf of X x + h X u where {X n } are 

iid Bernoulli. 

(d) We have 


2 r °° 1- Re<j>{t) di _2 r °° 1 - E(costX) 

* Jo t 2 7T Jo 


_2 f c 

Jo 


t 2 

1 — cost A 
<2 




and applying Fubini’s theorem, and then the fact that cos is an even func- 
tion we get 




— cos t X 


t 2 


dt 




and with the change of variable s = t|A|, we get 


dsE\X\ = 2E\X\, 



since (1 — cos(s)) / (ns 2 ) is a density. 
9.9.10. We have 


£( e *‘(n-»)/v'7) _ eX p{s[e it /' /7 - 1 - it/y/s]} 


so it suffices to show 


s[ e ,f /v^ _ 1 _ it/^/s] -f i % 


-4 0. 


However 



it . 1 , 

V? 1 + 2' 


<s 


- 1 - 4 = 

s/s 

it 


[e 


_ i _ 2 L 


yf* 


s it 

“3 7 ^ 


3 1 

= 0 ( 


1/2 > 



as s -4 oo. 

9.9.12. Let Xj = Xjli\ Xj \<ta n ] so that 


P 


n Y* n v 

. . u n , a n 

J=1 J=1 


< P 


U[l*il>fan] 

j= 


< E p [ i A 7 > ta »] ^ °- 

i=i 


So 




and jt suffices to show => TV by Slutsky’s theorem. Mimic the standard 
proof: The statement 


follows from 


Ee ,tS ' n = Y\^ e>tX ^ an e -p / 2 

l 


Y^E{e itX 'i la *) - 1 + f 2 /2 -4 0 

J = 1 


since 

exp{^£ l (e' tX j /,a ") - 1} - f[Ee itX 'i lan -4 0. 


( 1 ) 


( 2 ) 


( 3 ) 
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The reason for (3) is that by the product comparison lemma, the difference 
in (3) is 


it 

|3| <]T lexp {Ee itx '^ an - 1} - Ee itX '> /a ' 

j = l 
n 

=]T) lexp {Ee itx i /an - 1} - 1 - E(e itx 'j /a » - 1)1 
j = i ' 

3 = 1 

where zj = Ee' tx '^ an — 1. Now 

\ Zj \ =\ £e*' tX >" - 1| = | £e’ tx >» - 1 - UX'j/on |, 

(since EX'- = 0 due to symmetry of P[Xj < x]) 

<E( 1 t>W ) '- t, E( X lY 1 
£B l2‘ a; -2 E [^J '[!&!<.] 

j2 n / y \ 2 

<jV E ( ?) 1 ri£Ld< t i ->o 

2 j l 1 \ a nJ 

as 7i -4 oo. The reason for the convergence to 0 is that for any e > 0 

E (~) < E (—') lri£d<- 1 + E lr ix, i „ ] 

\ a nJ \a n J [ec^Stj 


(*) 


<e 2 + < 2 ]T\P 

j = l 


' Xj 



> e 

. a r> 

. 


-)■ e 2 + 0 = e 2 . 


We conclude that as n — > oo, \zj \ — > 0 uniformly in j. It follows that for 
any S > 0 and n sufficiently large, 

3 = 1 3=1 j=l V " / 


(by *) 






St 2 
2 ' 


Since S is arbitrary |3[ — > 0. 
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It remains to show (2) or what is the same thing 

> 2 ' 


since 


Now 


pE - 1 - _ o, 

n / Y>\ 2 n / V \ 2 

j ~ ( ~ ^ -► L 

fr[ \ a nJ “ \a n J ll=i-|<*J 


I2'l 


3 = 1 

and for e < t this is 


X,- 


‘ilSIs'i 


( 2 ') 


-f£(' 


3 = 1 


Xj 

3 

Xj 

J 

Q>n 


J 

Q>n 


i r *, i 

l £< =* *] 


3 n 






> e 


and since the first sum converges to land the second converges to 0, we get 


e|t | 3 „ 

nr + 0 ' 


Now e > 0 is arbitrary so 2' — ► 0 as n — > oo. 
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